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GROUND OF THE INVENTION 

[0001] The present invention relates to an information creating apparatus, an information 
creating method, a reproducing apparatus, a reproducing method, and a program. More 
particularly, the invention relates to an information creating apparatus, an information creating 
method, a reproducing apparatus, a reproducing method, and a program for ensuring real-time 
reproduction of AV (Audio-Visual) data without triggering picture quality degradation and other 
irregularities. 

[0002] In recent years, recording media such as CD-RW (Compact Disc-Re Writable) and DVD- 
RW (Digital Versatile Disc-Re Writable) have come into general use thanks to their declining 
prices. These disc-like recording media permit random access to data wherever they are recorded 
on the disc. When video and audio data (AV data) are written to and deleted from the disc 
repeatedly, some of the AV data that should be reproduced consecutively often end up being 
recorded in discontinuous areas on the disc. 

[0003] Continuous data could also be recorded discontinuously on the disc where AV data are 
subjected to non-destructive editing. Non-destructive editing involves establishing only so-called 
edit points (e.g., IN and OUT points) with regard to AV data recorded as raw material data on 
the optical disc or the like and not actually editing (i.e., destroying) the material data. A non- 
destructive editing process typically creates an edit list, a list of edit points that have been 
established regarding the material data. After the editing, the material data are reproduced from 
the optical disc in accordance with the edit points described in the edit list. 

[0004] Where raw material data have undergone irreversible conversion such as MPEG (Moving 
Picture Experts Group) encoding and where non-destructive editing is in use, there is no need for 
such conventional processes as decoding the material data, combining the decoded results 
according to the edit points described in the edit list, and again subjecting the combined material 
data to MPEG encoding. Without the repetitive decoding and encoding, it is possible to prevent 
picture quality degradation or related irregularities. 

[0005] When AV data recorded in discontinuous areas on the optical disc are to be reproduced 
following non-destructive editing, seeks occur from one recorded area to another on the 
apparatus carrying out the reproduction. 

[0006] If the time required for a seek is inordinately long, the AV data item to be reproduced at 
that point may not be retrieved in time. In that case the reproduction process can be interrupted, 
which means real-time reproduction of AV data is not guaranteed. 

[0007] U.S. patent application Ser. No. 10/029903 discloses a technique whereby 
discontinuously recorded raw material data are rearranged into bridge clips so as to minimize 
seek time. The disclosed technique is intended to avert a buffer underflow stemming from 
prolonged seek times and thereby to ensure real-time reproduction of AV data. 

[0008] However, creating bridge clips and referencing them for reproduction will resolve the 
problem of prolonged seek times with the reproducing apparatus but leaves one thing unresolved. 
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That is, if the reproducing apparatus has only one decoder capable of decoding at standard speed, 
then it is difficult to reproduce AV data (MPEG stream) that were recorded by the MPEG 
method on the optical disc, in accordance with the edit points described in the edit list. 

[0009] The MPEG method involves three picture types: I (Intra) pictures, P (Predictive) pictures, 
and B (Bidirectionally predictive) pictures. The I picture is intra-encoded without reference to 
any other picture. The P picture is predictively encoded using a predicted picture created by 
referencing an I or P picture that was intra-encoded or displayed earlier. The B picture is 
predictively encoded using a predicted picture created by referencing either or both of two kinds 
of pictures: an I or P picture intra-coded or displayed earlier, and an I or P picture to be displayed 
later. 

[0010] The decoding takes place in the same sequence. Each picture is decoded by referencing a 
picture to be displayed later as needed. 

[001 1] Under such a scheme, depending on the type of the picture for which an IN point is set 
(i.e., any one of an I, a P, and a B picture), it is necessary to decode in advance an undisplayed 
picture, i.e., a picture decoded only for reference purposes preparatory to decoding and 
displaying the picture in question. That process can make it impossible for the standard-speed 
decoder to ensure real-time reproduction. 

[0012] More specifically, suppose that a Long GOP (Group Of Pictures) structure is made up of 
GOP's of 15 frame pictures each wherein every third picture is an I or P picture. 

[0013] Suppose also that the pictures constituting one GOP are each represented by an alphabetic 
character that stands for a picture type (I, P, or B) combined with a numeral denoting a location 
in order of display. In that case, one GOP may illustratively constitute of Bl, B2, 13, B4, B5, P6, 
B7, B8, P9, B10, Bl 1, P12, B13, B14, and P15. 

[0014] A B picture may need to be encoded by referencing not only a picture that was displayed 
earlier but also a picture to be displayed later. If the picture to be displayed later has yet to be 
decoded upon decoding of a given B picture, that B picture cannot be decoded at that point. 

[0015] Under the MPEG scheme, the picture to be referenced preparatory to decoding any B 
picture is decoded earlier than that B picture. It follows that the pictures Bl through PI 5 making 
up the above-described GOP is decoded in the order of 13, Bl, B2, P6, B4, B5, P9, B7, B8, P12, 
B10,Bll,P15,B13,andB14. 

[0016] More specifically, the pictures Bl and B2'are decoded by referencing the picture PI 5 
displayed earlier from the preceding GOP and the picture 13 to be displayed later from the same 
GOP. The picture 13 is decoded without reference to any other picture. The pictures B4 and B5 
are decoded by referencing the picture 13 displayed earlier from the same GOP and the picture 
P6 to be displayed later from the same GOP. The picture P6 is decoded by referencing the 
picture 13 displayed earlier from the same GOP. The pictures B7 and B8 are decoded by 
referencing the picture P6 from the same GOP and the picture P9 to be displayed later from the 
same GOP. The picture P9 is decoded by referencing the picture P6 displayed earlier from the 
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same GOP. The pictures BIO and Bl 1 are decoded by referencing the picture P9 displayed 
earlier from the same GOP and the picture PI 2 to be displayed later from the same GOP. The 
picture P12 is decoded by referencing the picture P9 from the same GOP. The pictures B13 and 
B 14 are decoded by referencing the picture PI 2 displayed earlier from the same GOP and the 
picture PI 5 to be displayed later from the same GOP. The picture PI 5 is decoded by referencing 
the picture PI 2 displayed earlier from the same GOP. 

[0017] As described, the number of pictures to be decoded in advance varies depending on the 
type of the picture, which is about to be decoded and for which an edit point is set. As a result, 
the time and the location at which to start decoding a given picture vary accordingly. 

[0018] Described below with reference to FIGS. 1 A, IB, and 1C is how AV data recorded by the 
MPEG method are typically decoded thereby. It is assumed here that an m-th GOP from the 
beginning of AV data is represented by GOP(m) and that, as shown in FIG. 1 A, an edit list 
requires having pictures Bl through B13 of GOP(m) displayed between a time t.sub.l and a time 
t.sub.2 and having a picture P9 of GOP(n) through a picture P9 of GOP(n+l ) immediately after 
GOP(n) displayed between the time t.sub.2 and a time t.sub.3. In such a case, the decoding based 
on these requirements is carried out as shown in FIG. IB. 

[0019] More specifically, in order to display the pictures Bl through B13 of GOP(m) in that 
order between the time t.sub.l and the time t.sub.2, it is necessary to decode the pictures in the 
order of 13, Bl, B2, P6, B4, B5, P9, B7, B8, P12, B10, Bl 1, P15, and B13. 

[0020] In order to display the pictures P9 through B15 of GOP(n) in that order between the time 
t.sub.2 and the time t.sub.3, it is necessary to decode the pictures in the order of 13, P6, P9, PI 2, 
B10, Bl 1, PI 5, B13, and B14. During the decoding, the picture P6 needs to be referenced so as 
to decode the picture P9 of GOP(n) for which an IN point is set; the picture 13 needs to be 
referenced in order to decode the picture P6. With regard to GOP(n), the pictures are thus 
decoded in the order of 13, P6, P9, etc., in that order, including the undisplayed pictures 13 and 
P6. 

[0021] Likewise, in order to display the pictures Bl through B9 of GOP(n+l) in that order, it is 
necessary to decode the pictures in the order of 13, Bl, B2, P6, B4, B5, P9, B7, and B8. 

[0022] Referring to FIG. IB, the picture Bl of GOP(m) ought to have been decoded before the 
time t.sub.l at which the picture Bl is required to start being displayed. Given that requirement, 
it is necessary to start decoding the picture 13 of GOP(m) at a time t.sub.l' before the time 
t.sub.l, early enough to decode two pictures (13 and Bl) in time. 

[0023] Similarly, the picture P9 of GOP(n) ought to have been decoded before the time t.sub.2 at 
which the picture P9 is required to start being displayed (i.e., the time at which the display of the 
picture B13 of GOP(m) ends). That means the picture P9 should start getting decoded by a time 
t.sub.2 1 before the time T.sub.2, early enough to decode in time the picture P9 itself. 

[0024] However, as shown in FIG. IB, the decoding of the picture P9 actually starts at a time 
t.sub.2" after the time t.sub.2, i.e., after a period in which to decode another picture (picture P6). 
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The location at which to start decoding is thus delayed by the period between the time t.sub.2' 
and the time t.sub.2". That is, although not shown, the picture on display freezes during the 
period needed to decode the pictures 13 and P6 to be referenced in decoding the picture P9. 

[0025] As shown in FIG. 1C, the period between the time t.sub.2 at which the display of the 
picture B13 of GOP(m) ends (i.e., the time at which the display of the picture B9 of GOP(n) 
ought to start) and a time t.sub.4 at which the display of the picture P9 starts corresponds to the 
period between the time t.sub.2' and the time t.sub.2" in FIG. IB (the period needed to decode 
the two pictures). The freeze of the display takes place during that period. 

[0026] Depending on the edit point in effect, it is thus necessary to decode not only the picture 
about to be displayed but also some other pictures not to be displayed. Although the technique 
proposed by the above-cited patent application resolves the problem of prolonged seek times, it 
falls short of ensuring real-time reproduction of AV data. 

[0027] If GOP(m) and GOP(n) in FIGS. 1 A and IB are located in discontinuous areas, a seek 
time is needed for the reproducing apparatus to switch from one area to another. In that case, the 
freeze period discussed above becomes longer than the period of time in which to decode the two 
pictures. 

[0028] The technique proposed by the above-cited patent application imposes furthers 
restrictions on edited AV data: in order to reproduce each connection point (i.e., edit point) in 
seamless fashion, unnecessary pictures need to be removed from around each edit point and the 
resulting AV data near the edit point need to be re-encoded into a single continuous MPEG 
stream. Such re-encoding can incur degradation of picture quality. 

[0029] For example, if a bridge clip forming a plurality of GOP's includes an edit point, the clip 
needs to be decoded so that any unnecessary picture are removed from near that edit point. The 
decoded data minus the unnecessary pictures are again encoded into a bridge clip. The re- 
encoding process can degrade the quality of pictures that are obtained by reproducing the bridge 
clip. 

[0030] The present invention has been made in view of the above circumstances and provides an 
information creating apparatus, an information creating method, a reproducing apparatus, a 
reproducing method, and a program for ensuring real-time reproduction of AV data without 
incurring the degradation of picture quality or other irregularities. 

SUMMARY OF THE INVENTION 

[0031] In carrying out the invention and according to one aspect thereof, there is provided an 
information creating apparatus for creating information to be provided to a reproducing 
apparatus for reproducing data. The information creating apparatus includes a first acquiring 
element for acquiring edit point information describing an edit point set for the data, and a 
creating element for creating reproduction control information in accordance with the edit point 
information acquired by the first acquiring element, the reproduction control information 
resulting from an editing process based on the edit point and serving to control reproduction of 
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the data. 

[0032] Preferably, the reproducing apparatus may further include a determining element for 
determining whether it is possible for the reproducing apparatus to reproduce in real time the 
data resulting from the editing process, and a relocating element for relocating data in proximity 
of the edit point if the determining element determines that it is impossible for the reproducing 
apparatus to reproduce in real time the data resulting from the editing process. The creating 
element may create the reproduction control information including information for indicating the 
data relocated by the relocating element as a reproduction object. 

[0033] The creating element may preferably create the reproduction control information 
including information for designating a decoder of the reproducing apparatus for use in 
reproducing the data. 

[0034] Preferably, the information creating apparatus may further include a determining element 
for determining a location at which the reproducing apparatus starts reproducing the data. The 
creating element may create the reproduction control information including information for 
designating the starting location determined by the determining element. 

[0035] The creating element may preferably create the reproduction control information 
including information for designating the starting location determined by the determining 
element using address information processible by the reproducing apparatus. 

[0036] Preferably, the information creating apparatus may further include a second acquiring 
element which, if the data are constituted by pictures, then acquires picture information about the 
pictures. The creating element may create the reproduction control information in accordance 
with the picture information acquired by the second acquiring element. 

[0037] According to another aspect of the invention, there is provided an information creating 
method for creating information to be provided to a reproducing apparatus for reproducing data. 
The information creating method includes the steps of acquiring edit point information 
describing an edit point set for the data, and creating reproduction control information in 
accordance with the edit point information acquired in the acquiring step, the reproduction 
control information resulting from an editing process based on the edit point and serving to 
control reproduction of the data. 

[0038] According to a further aspect of the invention, there is provided a first program for 
causing a computer to create information to be provided to a reproducing apparatus for 
reproducing data. The first program includes the steps of acquiring edit point information 
describing an edit point set for the data, and creating reproduction control information in 
accordance with the edit point information acquired in the acquiring step, the reproduction 
control information resulting from an editing process based on the edit point and serving to 
control reproduction of the data. 

[0039] According to an even further aspect of the invention, there is provided a reproducing 
apparatus including an acquiring element for acquiring reproduction control information, which 
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is created in accordance with edit point information describing an edit point set for data and 
which serves to control reproduction of the data, and a reproducing element for reproducing the 
data in accordance with the reproduction control information acquired by the acquiring element. 

[0040] Preferably, the reproducing apparatus may further include a determining element and a 
selecting element for use when the reproduction control information includes information for 
indicating as a reproduction object data, which are relocated by an information creating 
apparatus for creating the reproduction control information and which are in proximity of the edit 
point. The determining element may determine a location at which to start reproducing the data 
in accordance with the reproduction control information. The selecting element may select a 
decoder for reproducing the data. The reproducing element may reproduce the data based on the 
reproduction control information, on the starting location determined by the determining 
element, and on the decoder selected by the selecting element. 

[0041] Preferably, the reproducing apparatus may further include a determining element for use 
when the reproduction control information includes information for indicating as a reproduction 
object data, which are relocated by an information creating apparatus for creating the 
reproduction control information and which are in proximity of the edit point, and information 
for designating a decoder for reproducing the data. The determining element may determine a 
location at which to start reproducing the data in accordance with the reproduction control 
information. The reproducing element may reproduce the data based on the reproduction control 
information and on the starting location determined by the determining element. 

[0042] Preferably, if the reproduction control information includes information for indicating as 
a reproduction object data, which are relocated by an information creating apparatus for creating 
the reproduction control information and which are in proximity of the edit point, information for 
designating a decoder for reproducing the data, and information for designating a location at 
which to start reproducing the data, then the reproducing element may reproduce the data solely 
in accordance with the reproduction control information. 

[0043] According to a still further aspect of the invention, there is provided a reproducing 
method including the steps of acquiring reproduction control information, which is created in 
accordance with edit point information describing an edit point set for data and which serves to 
control reproduction of the data, and reproducing the data in accordance with the reproduction 
control information acquired in the acquiring step. 

[0044] According to a yet further aspect of the invention, there is provided a second program, 
which is readable by a computer, including the steps of acquiring reproduction control 
information, which is created in accordance with edit point information describing an edit point 
set for data and which serves to control reproduction of the data, and reproducing the data in 
accordance with the reproduction control information acquired in the acquiring step. 

[0045] Where the information creating apparatus, information creating method, and first program 
according to the invention are in use, edit point information describing edit points set for data is 
first acquired. Then reproduction control information is created on the basis of the edit point 
information. The reproduction control information serves to control reproduction of the data 
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resulting from an editing process based on the edit points. 

[0046] Where the reproducing apparatus, reproducing method, and second program according to 
the invention are in use, reproduction control information is first acquired after its creation on the 
basis of edit point information describing edit points set for data. The reproduction control 
information thus acquired is used to control reproduction of the data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0047] These and other objects of the invention will be seen by reference to the description, 
taken in connection with the accompanying drawing, in which: 

[0048] FIGS. 1A, IB, and 1C are schematic views showing how AV data are typically 
reproduced; 

[0049] FIG. 2 is a block diagram depicting a typical structure of a disc apparatus according to the 
invention; 

[0050] FIGS. 3A and 3B are schematic views illustrating how a bridge clip is typically created; 
[0051] FIG. 4 is a tabular view giving a typical edit list; 

[0052] FIG. 5 is a block diagram indicating a typical structure of a personal computer; 

[0053] FIG. 6 is a block diagram presenting a typical structure of a reproducing apparatus; 

[0054] FIG. 7 is a block diagram outlining another typical structure of the reproducing apparatus; 

[0055] FIG. 8 is a tabular view showing how pictures are typically scheduled for decoding; 

[0056] FIGS. 9A, 9B, and 9C are schematic views depicting typical decoding by a plurality of 
decoders; 

[0057] FIG. 10 is a schematic view giving Nip, the number of I and P pictures to be decoded 
beforehand regarding each picture to be displayed; 

[0058] FIG. 1 1 is a schematic view indicating scheduling conditions; 

[0059] FIG. 12 is a flowchart of steps constituting a play list creating process performed by the 
disc apparatus of FIG. 2; 

[0060] FIG. 13 is a flowchart of steps constituting the play list creating process continued from 
the process of FIG. 12 and performed by the disc apparatus of FIG. 2; 

[0061] FIG. 14 is a schematic view of a typical edit list; 
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[0062] FIG. 15 is a tabular view of typical picture pointers; 

[0063] FIG. 16 is a schematic view showing how a bridge clip is typically created; 

[0064] FIG. 17 is another schematic view showing how a bridge clip is typically created; 

[0065] FIG. 18 is a schematic view of a typical play list; 

[0066] FIG. 19 is a schematic view of another typical play list; 

[0067] FIG. 20 is a flowchart of steps constituting a reproducing process performed by the 
reproducing apparatus of FIG. 6; 

[0068] FIG. 21 is a schematic view indicating how AV data are typically reproduced;. 

[0069] FIG. 22 is a schematic view outlining how AV data are typically displayed; 

[0070] FIG. 23 is a block diagram sketching another typical structure of the disc apparatus 
according to the invention; 

[0071] FIG. 24 is a block diagram giving another typical structure of the reproducing apparatus 
according to the invention; 

[0072] FIG. 25 is a flowchart of steps performed by the disc apparatus of FIG. 23; 

[0073] FIG. 26 is a schematic view of a typical play list created in the steps of FIG. 25; 

[0074] FIG. 27 is a flowchart of steps constituting a reproducing process carried out by the 
reproducing apparatus of FIG. 24; 

[0075] FIG. 28 is a block diagram showing another typical structure of the disc apparatus 
according to the invention; 

[0076] FIG. 29 is a block diagram depicting another typical structure of the reproducing 
apparatus according to the invention; 

[0077] FIG. 30 is a flowchart of steps performed by the disc apparatus of FIG. 28; 
[0078] FIG. 3 1 is a schematic view of a typical play list created in the steps of FIG. 30; 
[0079] FIG. 32 is a flowchart of steps performed by the reproducing apparatus of FIG. 29; 
[0080] FIG. 33 is a flowchart of other steps performed by the disc apparatus of FIG. 28; 
[0081] FIG. 34 is a schematic view of a typical play list created in the steps of FIG. 33; 
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[0082] FIG. 35 is a flowchart of other steps performed by the reproducing apparatus of FIG. 29; 
and 

[0083] FIG. 36 is a block diagram showing a typical structure of an information processing 
apparatus. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0084] FIG. 2 is a block diagram depicting a typical structure of a disc apparatus 1 (i.e., 
information creating apparatus) according to the invention. As shown in FIG. 2, the disc 
apparatus 1 is made up of an information processing block 1 1 and a drive 12. 

[0085] The information processing block 1 1 includes an interface 21, a control unit 22, an 
address managing unit 23, a real-time reproduction feasibility determining unit 24, a device 
information storing unit 25, a bridge clip creating unit 26, an additional information creating unit 
27, a play list creating unit 28, a picture pointer creating unit 29, a read unit 30, and a write unit 
3 1 . An edit list written on an optical disc 52 loaded in the drive 12 is retrieved. A play list is then 
created on the basis of the retrieved edit list. 

[0086] The edit list is a list of so-called edit points (i.e., IN and OUT points) set for specific 
locations of AV (Audio Visual) data recorded on the optical disc 52. The play list is a revised 
edit list. That is, the edit list is modified into a play list such that the reproducing apparatus upon 
referencing the list can ensure real-time reproduction of AV data (recorded along with the play 
list on the optical disc 52) in accordance with the IN and OUT points resulting from a non- 
destructive editing process and described in the edit list. 

[0087] The optical disc 52 retains AV data encoded by the MPEG (Moving Picture Experts 
Group) method, and an edit list created during editing of the AV data. If the reproducing 
apparatus loaded with the optical disc 52 reproduces the AV data simply in keeping with the edit 
list, the apparatus may not be capable of real-time reproduction of the AV data because of the 
above-described problem of prolonged seek times or a freeze taking place depending on where 
the edit point in question is located. 

[0088] In order to bypass the above problem, the information processing block 1 1 modifies the 
edit list into a play list to ensure real-time reproduction of the AV data recorded on the optical 
disc 52, and writes the newly created play list to the optical disc 52. Thereafter, the reproducing 
apparatus (e.g., a reproducing apparatus 101, to be discussed later with reference to FIG. 6) 
loaded with the optical disc 52 carrying the play list reproduces the AV data recorded on the disc 
in keeping with the play list also stored on the disc. This ensures real-time reproduction of the 
AV data. 

[0089] How a play list is created and how AV data are reproduced in accordance with the created 
list will be described later in detail with reference to the accompanying flowcharts. 

[0090] Referring to FIG. 2, the interface 21 controls such components as an operation unit 
including a keyboard and a mouse, a display unit for displaying pictures, and speakers for 
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outputting sounds (none shown). When a user operates the operation unit, the interface 21 
supplies the control unit 22 with signals representing the user's operations. The interface 21 also 
causes the display unit and speakers to output information that may be fed from the control unit 
22. 

[0091] Illustratively, given operation signals from the interface 21, the control unit 22 controls 
the real-time reproduction feasibility determining unit 24, device information storing unit 25, 
bridge clip creating unit 26, additional information creating unit 27, play list creating unit 28, and 
picture pointer creating unit 29 accordingly. 

[0092] The address managing unit 23 implemented by a file system 81 (FIG. 5, to be discussed 
later) manages physical and logical addresses on the optical disc 52. For example, when a logical 
address of AV data is received from the real-time reproduction feasibility determining unit 24, 
the address managing unit 23 converts the address into a physical address and outputs the 
converted address back to the unit 24. Given such a physical address from the address managing 
unit 23, the real-time reproduction feasibility determining unit 24 determines whether 
reproduction of the corresponding AV data held on the optical disc 52 is feasible in real time. 

[0093] More specifically, the real-time reproduction feasibility determining unit 24 determines 
whether the reproducing apparatus can reproduce in real time the AV data derived from non- 
destructive editing in accordance with picture pointers and an edit list coming from a picture 
pointer reading unit 41 or with information from the device information storing unit 25. 

[0094] As will be described later, picture pointers constitute a table of information to be added to 
each clip. The table describes data sizes, file addresses (logical addresses), and picture types of 
the pictures making up the clip. The picture types include I (Intra pictures), P (Predictive 
pictures), and B (Bidirectionally predictive pictures). 

[0095] The device information storing unit 25 accommodates device information denoting the 
specifications of the reproducing apparatus, and supplies the information to the real-time 
reproduction feasibility determining unit 24 and bridge clip creating unit 26. The device 
information stored in the device information storing unit 25 illustratively includes the read rate of 
an internal disc drive, the size of an internal buffer, an AV data reproduction rate (i.e., decoding 
speed), and the number of incorporated decoders, all associated with the reproducing apparatus. 
The device information may be either set by the user operating the operation unit or prearranged 
to include information about the standardized specifications of the reproducing apparatus. 

[0096] If the real-time reproduction feasibility determining unit 24 determines that the 
reproducing apparatus is incapable of real-time reproduction of AV data in a predetermined 
range (also called a clip, e.g., a series of video data composed of GOP's [Groups Of Pictures]), 
then the bridge clip creating unit 26 creates a bridge clip based on data from a main line data 
reading unit 43, in such a mariner that the seek time involved will be minimized upon 
reproduction of the AV data. 

[0097] As described above, the bridge clip needs to be created in cases where AV data stored 
discontinuously on the optical disc are to be reproduced continuously and where the time to seek 
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a reproduction object from one discontinuous area to another is predicted to be so prolonged as 
likely to cause a buffer underflow. 

[0098] Described below with reference to FIGS. 3A and 3B is how a bridge clip is typically 
created by the bridge clip creating unit 26. As viewed in FIGS. 3A and 3B, data are read or 
written from left to right on the optical disc 52. 

[0099] It is assumed here that an m-th GOP from the beginning of AV data is represented by 
GOP(m). On that assumption, FIG. 3 A indicates three clips: a clip #1 composed of GOP(m), 
GOP(m+l), and GOP(m+2); a clip #2 formed by GOP(o); and a clip #3 made up of GOP(n), 
GOP(n+l), and GOP(n+2). A blank area #1 is formed between GOP(m+2) and GOP(n) and a 
blank area #2 between GOP(n+2) and GOP(o). Blank areas are often formed on the optical disc 
52 if data write and erase operations are carried out repeatedly on the disc. 

[0100] In the above conditions, suppose the AV data are edited in such a manner that the pictures 
ranging from the first picture of GOP(m) for which an IN.sub.l point is set, to the picture of 
GOP(m+2) for which an OUT.sub.l point is set are reproduced first; that the pictures ranging 
from the picture of GOP(o) for which an IN.sub.2 point is set following GOP(m+2), to the 
subsequent picture of GOP(o) for which an OUT.sub.2 point is set are then reproduced; and that 
the pictures ranging from the picture of GOP(n) for which an IN. sub. 3 point is set preceding 
GOP(o), to the last picture of GOP(n+2) for which an OUT.sub.3 point is set are reproduced 
finally. 

[0101] The reproduction above takes place in accordance with an edit list shown in FIG. 4. In 
FIG. 4, TC(IN.sub.l) and TC(OUT.sub.l) denote respectively time codes (TC) of the IN.sub.l 
and OUT.sub.l points set for the clip #1. TC(IN.sub.2) and TC(OUT.sub.2) represent 
respectively time codes (TC) of the IN.sub.2 and OUT.sub.2 points set for the clip #2. Likewise, 
TC(IN.sub.3) and TC(OUT.subJ) indicate respectively time codes (TC) of the IN.sub.3 and 
OUT.sub.3 points set for the clip #3. 

[0102] According to the edit list of FIG. 4, the picture designated by TC(IN.sub.l) through the 
picture designated by TC(OUT.sub.l) are reproduced first; the picture designated by 
TC(IN.sub.2) through the picture designated by TC(OUT.sub.2) are reproduced next; and the 
picture designated by TC(IN.sub.3) through the picture designated by TC(OUT.sub.3) are 
reproduced last. The AV data shown in FIG. 3 A are reproduced in that manner. 

[0103] After the edit list is created in the manner described above, the AV data are reproduced in 
accordance with the created list. This brings about the desired results of AV data edit word with 
no need to re-encode the AV data. 

[0104] Conventionally, AV data irreversibly encoded illustratively by the MPEG method are 
again decoded so that unnecessary pictures (i.e., pictures outside the range between the IN point 
and the OUT point) other than the objects of reproduction are removed. The decoded AV data 
minus the unnecessary pictures need to be re-encoded for editing. By contrast, non-destructive 
edit work based on the edit list eliminates the need for such conventional intervention and thus 
prevents degradation of picture quality. 
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[0105] Returning to the explanation of FIG. 3 A, the clips #1, #2, and #3 are recorded in 
discontinuous areas. For that reason, reproduction of the clips in keeping with the edit list of 
FIG. 4 entails a seek #1 from the OUT.sub.l point of the clip #1 to the IN.sub.2 point of the clip 
#2, and a seek #2 from the OUT.sub.2 point of the clip #2 to the IN.sub.3 point of the clip #3. -If 
the seek time involved is prolonged, retrieval of the AV data from the optical disc 52 may fail to 
keep up with real-time reproduction of the data, as discussed above. That can trigger an 
interruption of the ongoing AV data reproduction. 

[0106] The reproducing apparatus typically includes a buffer for temporarily storing (i.e., 
buffering) the AV data read from the optical disc 52, and a decoder for decoding the buffered 
AV data. If all buffered AV data have been read out of the buffer by the decoder, a buffer 
underflow occurs and an interruption of real-time reproduction takes place. In other words, to 
ensure real-time reproduction requires retaining in the buffer an enough amount of AV data that 
can be decoded to cover the time period required for a seek that may take place. 

[0107] In order to circumvent the above problem, the bridge clip creating unit 26 of FIG. 2 
relocates parts of clips in units of GOP's into a blank area. This area constitutes a bridge clip 
made up of a plurality of relocated GOP's. The bridge clip is set to be reproduced by the 
reproducing apparatus to ensure real-time reproduction. 

[0108] More specifically, suppose that the AV data in FIG. 3 A are reproduced by the 
reproducing apparatus in keeping with the edit list and that the real-time reproduction feasibility 
determining unit 24 predicts a buffer underflow occurring during the seek #1 or #2. In that case, 
the bridge clip creating unit 26 creates a bridge clip by relocating into a blank area #1 a 
predetermined range of data in the clips to seek, illustratively in units of GOP'S, as shown in 
FIG. 3B. 

[0109] In the example of FIG. 3B, GOP(m+2) of the clip #1, GOP(o) of the clip #2, and GOP(n) 
of the clip #3 are relocated into the blank area #1 . This forms a bridge clip made up of 
GOP(m+2), GOP(o), and GOP(n). 

[0110] After creating the bridge clip in this manner, the disc apparatus 1 modifies the edit list 
into a play list so that reproduction will take place in reference to the bridge clip. The play list 
thus created is supplied to the reproducing apparatus along with the AV data. 

[0111] Given the play list and AV data, the reproducing apparatus reproduces the first picture of 
GOP(m) through the last picture of GOP(m+l) in accordance with the play list as shown in FIG. 
3B, before switching to the bridge clip for the object of reproduction. The reproducing apparatus 
then reproduces the bridge clip from the first picture of GOP(m+2) to the picture for which the 
OUT.sub.l point is set, from the picture for which the IN.sub.2 point is set to the picture for 
which the OUT.sub.2 point is set in GOP(o), and from the picture of GOP(n) for which the 
IN.sub.3 point is set to the last picture of GOP(n), in that order. After reproducing the bridge 
clip, the reproducing apparatus reproduces the first picture of GOP(n+l) through the last picture 
of GOP(n+2) in the clip #3 . 
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[0112] It should be noted that in FIG. 3B, the GOP's not to be reproduced are shown shaded. 

[0113] If the play list is referenced for switching from one picture to another for the object of 
reproduction, seeks occur in the following order: a seek #3 upon switching from the last picture 
of GOP(m+l) to the first picture of GOP(m+2) in the bridge clip; a seek #4 upon switching from 
the picture of GOP(m+2) for which the OUT.sub. 1 point is set, to the picture of GOP(o) for 
which the IN.sub.2 point is set; a seek #5 upon switching from the picture of GOP(o) for which 
the OUT.sub.2 point is set, to the picture of GOP(n) for which the IN.sub.3 point is set; and a 
seek #6 upon switching from the last picture of GOP(n) to the first picture of GOP(n+l). 

[01 14] A comparison between FIGS. 3A and 3B clearly indicates that the total time required for 
the seek #3 through the seek #6 in FIG. 3B is appreciably shorter than the time for the seek #1 
and seek #2 combined in FIG. 3A, while the displayed pictures are the same. Thus referencing 
the bridge clip shortens the seek time and helps prevent buffer underflow from taking place. 

[01 15] Returning to the explanation of FIG. 2, the bridge clip creating unit 26 outputs the above- 
described bridge clip to the write unit 3 1 . In turn, the write unit 3 1 writes the bridge clip to the 
disc 52 through a disc interface 51. The bridge clip creating unit 26 also outputs bridge clip- 
related information such as time codes and addresses associated with bridge clip locations, to the 
play list creating unit 28 and picture pointer creating unit 29. 

[01 16] The additional information creating unit 27 creates additional information for use in 
preparing a play list and outputs the created information to the play list creating unit 28. The 
additional information illustratively includes information for designating the times at which to 
start decoding clips as well as decoder designation information, i.e., information for specifying 
which clips are to be decoded by which decoder where the reproducing apparatus has a plurality 
of decoders. 

[0117] The play list creating unit 28 creates a play list based on the edit list coming from the 
control unit 22, on the bridge clip-related information from the bridge clip creating unit 26, and 
on the additional information from the additional information creating unit 27. The play list is 
described illustratively using a suitable language based on XML (extensible Markup Language). 
The play list created by the play list creating unit 28 is output to the picture pointer creating unit 
29 and write unit 3 1 . 

[0118] The picture pointer creating unit 29 creates picture pointers for the clips to be referenced 
in the play list (as the objects of reproduction) in accordance with the picture pointers supplied 
from the control unit 22, and outputs the created picture pointers to the write unit 31. The picture 
pointers regarding all clips recorded on the optical disc 52 are read therefrom by the picture 
pointer reading unit 41 and sent to the picture pointer creating unit 29 via the real-time 
reproduction feasibility determining unit 24 and control unit 22. 

[0119] The read unit 30 is made up of the picture pointer reading unit 41, an edit list reading unit 
42, and the main line data reading unit 43. The edit list reading unit 42 reads an edit list from the 
optical disc 52 and outputs the retrieved edit list to the picture pointer reading unit 41 . 
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[0120] Given the edit list from the edit list reading unit 42, the picture pointer reading unit 41 
reads from the optical disc 52 the picture pointers for the clips to be referenced in that edit list. 
The optical disc 52 retains AV data and the picture pointers for the clips constituting the 
recorded AV data. The picture pointers retrieved by the picture pointer reading unit 41 are output 
to the real-time reproduction feasibility determining unit 24 together with the edit list. 

[0121] The main line data reading unit 43 reads main line data (i.e., AV data) from the optical 
disc 52 via the disc interface 51, and outputs the retrieved main line data to the bridge clip 
creating unit 26. 

[0122] Given the bridge clip from the bridge clip creating unit 26, the write unit 31 writes the 
received bridge clip to a blank area on the optical disc 52 via the drive interface 51. Through the 
drive interface 51, the write unit 31 also writes to the optical disc 52 the play list created by the 
play list creating unit 28 and the picture pointers (for the clips to be referenced in the play list) 
created by the picture pointer creating unit 29. 

[0123] The drive 12 includes the disc interface 51 and writes and reads data through that 
interface to and from the optical disc 52 loaded in the drive 12. The optical disc 52 is attached to 
and detached from the disc drive 12 with ease. 

[0124] The optical disc 52 illustratively contains AV data acquired by a video camera, and 
information such as picture pointers for the clips constituting the AV data and an edit list. The 
optical disc 52 may be a Blu-ray (trademark) disc, a CD (Compact Disc), a DVD (Digital 
Versatile Disc), or the like. 

[0125] The structure described above is implemented illustratively by a personal computer 
outlined in FIG. 5. A CPU (Central Processing Unit) 61 of the PC performs various processes in 
keeping with programs held in a ROM (Read-Only Memory) 62 or with programs loaded from a 
storage unit 68 into a RAM (Random Access Memory) 63. The storage unit 68 illustratively 
contains the file system 81 that is executed to implement the address managing unit 23 of FIG. 2. 

[0126] The RAM 63 also contains data that may be required by the CPU 61 in carrying out its 
processes. The CPU 61, ROM 62, and RAM 63 are interconnected via a bus 64. The bus 64 is 
also connected to an input/output interface 65. 

[0127] The input/output interface 65 is connected to an input unit 66 illustratively made up of a 
keyboard and a mouse, and to an output unit 67 constituted by a display such as a CRT (Cathode 
Ray Tube) or an LCD (Liquid Crystal Display) and by speakers. The user enters instructions by 
operating the input unit 66. The entered instructions are input to the interface 21 of FIG. 2. The 
display as part of the output unit 67 illustratively indicates a table of edit lists read from the 
optical disc 52. The information processing block 1 1 creates a play list based on the edit list 
selected from the displayed table. 

[0128] The input/output interface 65 is further connected to the storage unit 68 such as a hard 
disc drive, a drive 69, and the drive 12 (FIG. 2). The drive 69 accommodates recording media 
other than the optical disc 52, such as removable media 70 including a memory card 
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incorporating a flash memory, a magnetic disc, and a magnetic tape. The drive 69 writes and 
reads data to and from the removable media 70. 

[0129] FIG. 6 is a block diagram presenting a typical structure of a reproducing apparatus 101 . In 
FIG. 6, a reproduction control block 1 1 1 includes a read unit 121, an address managing unit 122, 
a decode scheduling unit 123, and a decoder controlling unit 124. These units are implemented 
by a controller 153 of FIG. 7 carrying out relevant control programs. 

[0130] The reproduction control block 1 1 1 reproduces AV data in accordance with a play list 
that is held along with the AV data on the optical disc 52 loaded in a drive 1 12. In addition to the 
AV data, the optical disc 52 retains picture pointers and play lists for the clips created by the disc 
apparatus 1. 

[0131] The read unit 121 is made up of a picture pointer reading unit 131 and a play list reading 
unit 132. The play list reading unit 132 reads a play list from the optical disc 52 and outputs the 
retrieved list to the picture pointer reading unit 131. 

[0132] The picture pointer reading unit 131 reads from the optical disc 52 the picture pointers for 
the clips referenced in the play list supplied by the play list reading unit 132. The picture pointers 
read by the picture pointer reading unit 13 1 are output to the decode scheduling unit 123 together 
with the play list. 

[0133] The address managing unit 122 manages physical and logical addresses on the optical 
disc 52. More specifically, the controller 153 in FIG. 7 has program modules equivalent to the 
file system 81 of FIG. 5. Carrying out the program modules implements the address managing 
unit 122. Illustratively, the address managing unit 122 gets a logical address from the decode 
scheduling unit 123 and converts the received address into a physical address before sending the 
converted address back to the decode scheduling unit 123. 

[0134] After acquiring physical addresses of AV data from the address managing unit 122, the 
decode scheduling unit 123 performs decode scheduling based on the play list and picture 
pointers supplied from the picture pointer reading unit 131, whereby a decode starting time and a 
decode starting location (i.e., picture) are determined for each clip. 

[0135] Furthermore, the decode scheduling unit 123 has its decoder selecting unit 133 determine, 
which decoder is to start decoding at a predetermined decode starting time. As shown in FIG. 7, 
the reproducing apparatus 101 has a plurality of decoders (two decoders in the example of FIG. 
7). Schedule information for presenting decode starting times and other specifics and decoder 
designation information for designating the decoder to be used are output to the decoder 
controlling unit 124. 

[0136] The decoder controlling unit 124 controls the decoders in accordance with the schedule 
information and decoder designation information received. 

[0137] The drive 112 includes a disc interface 141 and writes and reads data through that 
interface to and from the optical disc 52 loaded in the drive 1 12. 
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[0138] The above-described structure of the reproduction control block 1 1 1 is implemented 
illustratively by the reproducing apparatus 101 of FIG. 7. 

[0139] An operation unit 152 is operated by the user. Operation signals corresponding to the 
user's operations on the unit 152 are output to the controller 153. 

[0140] The controller 153 controls the disc drive 1 12, a decoder unit 155, and a switcher 156 in 
response to the operation signals from the operation unit 152. More specifically, when the 
controller 153 receives from the operation unit 152 an operation signal requesting the 
reproduction of AV data in keeping with a play list, the controller 153 requests the disc drive 1 12 
to provide the play list. In response to the request, the disc drive 1 12 reads the play list from the 
optical disc 52 and places the retrieved play list onto a bus 151. The controller 153 receives the 
play list from the bus 151. 

[0141] The controller 153 (decode scheduling unit 123 in FIG. 6) performs decode scheduling 
and decoder selection in keeping with the received play list, and controls decoders 155.sub.l and 
155. sub. 2 for decoding the AV data according to schedule information and decoder designation 
information. In addition, the controller 153 causes the switcher 156 selectively to output the 
pictures decoded either by the decoder 155.sub.l or by the decoder 155.sub.2 on the basis of the 
edit points detected from the play list. 

[0142] A buffer unit 154 is made up of buffers 154.sub.l and 154.sub.2, which buffer AV data 
retrieved by the drive 112. The AV data buffered by the buffers 154.sub.l and 154.sub.2 are 
decoded by the downstream decoders 155.sub.l and 155.sub.2 respectively. Since the play list is 
described in a way requiring reference to bridge clips where necessary as described above, no 
buffer underflow occurs in the buffers 154.sub.l and 154. sub. 2 during the reproduction based on 
the play list. 

[0143] The decoders 155.sub.l and 155.sub.2 constituting the decoder unit 155 request the drive 
1 1 2 to provide A V data via the bus 1 5 1 . In response, the drive 1 1 2 outputs onto the bus 151 the 
requested AV data, which are received by the decoders 155.sub.l and 155. sub. 2 through the 
buffers 154.sub.l and 154. sub. 2 respectively. The decoders 155.sub.l and 155.sub.2 decode the 
received AV data under control of the controller 153, and output the decoded pictures to the 
switcher 156. 

[0144] It is assumed here that the decoders 155.sub.l and 155.sub.2 making up the decoder unit 
155 have standard-speed decoding speed each. The drive 1 12, which reads AV data from the 
optical disc 52 and supplies the retrieved data to the buffers 154.sub.l and 154.sub.2 (decoders 
155.sub.l and 155. sub. 2), is assumed to have a sufficiently high speed (a sufficiently wide band) 
to sustain the data supply. 

[0145] Under control of the controller 153, the switcher 156 selects either of the pictures 
decoded by the decoders 155.sub.l and 155.sub.2 and outputs the selected picture to a display 
unit 157. The display unit 157 displays the picture output by the switcher 156. That is, of the 
pictures decoded by the decoders 155.sub.l and 155.sub.2, the one selected by the switcher 156 
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is displayed on the display unit 157. 

[0146] What follows is a description of decode scheduling carried out by the decode scheduling 
unit 123. As discussed above, to decode AV data encoded in the Long GOP structure may 
require decoding undisplayed pictures, to ensure real-time reproduction. The undisplayed 
pictures are solely to be referenced in order to ensure the decoding of another picture depending 
on the picture type (I, P, or B) of the picture for which an IN point is set. 

[0147] The decode scheduling unit 123 performs decode scheduling as shown in FIG. 8. That is, 
the decode scheduling unit 123 first detects a picture for which an edit point (IN point) is set 
based on the play list and picture points furnished by the picture pointer reading unit 131 . 
Depending on the picture for which an edit point is set, the decode scheduling unit 123 
determines the sequence of the pictures to be decoded by the decoder 155.sub.l or 155. sub. 2. In 
FIG. 8, an n-th GOP from the beginning of AV data is indicated as GOP(n). 

[0148] More specifically, where the picture for which an edit point is set is a picture Bl of 
GOP(n), a minimum of undisplayed but necessary pictures to be decoded preparatory to 
decoding the picture Bl of GOP(n) are pictures 13, P6, P9, P12, and P15 of GOP(n-l), as shown 
in FIG. 8. In this case, the decode scheduling unit 123 arranges for the pictures 13, P6, P9, PI 2, 
and PI 5 of GOP(n-l) to be decoded first, in that order, followed by pictures of GOP(n) and on. 
That is, following the pictures 13, P6, P9, PI 2, and PI 5 of GOP(n-l), the decode scheduling unit 
123 arranges for the subsequent pictures of GOP(n) and on to be decoded in ordinary decoding 
order (13, Bl, B2, P6, B4, etc.). 

[0149] Where the picture for which an edit point is set is the picture B2 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture B2 of 
GOP(n) are the pictures 13, P6, P9, PI 2, and PI 5 of GOP(n-l). In that case, the decode 
scheduling unit 123 would arrange for the pictures 13, P6, P9, PI 2, and PI 5 of GOP(n-l) to be 
decoded first followed by the pictures 13, Bl, B2, P6, etc., of GOP(n). However, the picture Bl 
need not be decoded because it comes before the picture B2 with the edit point in order of 
display and because the picture Bl is neither displayed nor referenced. In this case, following the 
pictures 13, P6, P9, P12, and P15 of GOP(n-l), the decode scheduling unit 123 arranges for the 
picture 13 of GOP(n) to be decoded followed by the pictures B2 and P6, in that order. After that, 
the decode scheduling unit 123 arranges for the subsequent pictures to be decoded in ordinary 
decoding order. 

[0150] Where the picture for which an edit point is set is the picture 13 of GOP(n), there is no 
need to reference any other picture upon decoding of that picture 13. In this case, decoding is 
scheduled to start at the picture 13 of GOP(n). There is no need to decode the pictures Bl and B2 
located before the picture 13 with the edit point in order of display, because the pictures Bl and 
B2 are neither displayed nor referenced. Thus the decode scheduling unit 123 arranges for the 
picture 13 of GOP(n) to be decoded followed by the picture P6, with the pictures Bl and B2 
skipped. The subsequent pictures are then scheduled to be decoded in ordinary decoding order. 

[0151] Where the picture for which an edit point is set is the picture B4 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture B4 of 
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GOP(n) is the picture 13 of GOP(n) The decode scheduling unit 123 would then arrange for the 
picture 13 of GOP(n) to be decoded first followed by the subsequent pictures Bl, B2, P6, B4, B5, 
etc., of GOP(n) in decoding (and encoding) order. However, there is no need to decode the 
pictures Bl and B2 located before the picture B4 with the edit point in order of display, because 
the pictures Bl and B2 are neither displayed nor referenced. Thus the decode scheduling unit 123 
arranges for the picture 13 of GOP(n) to be decoded first followed by the picture P6 and 
subsequent pictures in ordinary decoding order, with the pictures Bl and B2 skipped. 

[0152] Where the picture for which an edit point is set is the picture B5 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture B5 of 
GOP(n) is the picture 13 of GOP(n). The decode scheduling unit 123 would then arrange for the 
picture 13 of GOP(n) to be decoded first followed by the subsequent pictures Bl, B2, P6, B4, B5, 
etc., of GOP(n) in decoding order. However, there is no need to decode the pictures Bl, B2, and 
B4 located before the picture B5 with the edit point in order of display because the pictures Bl, 
B2, and B4 are neither displayed nor referenced. Thus the decode scheduling unit 123 arranges 
for the picture 13 of GOP(n) to be decoded first followed by the picture P6, with the pictures Bl 
and B2 skipped. The decode scheduling unit 123 further arranges for the picture B5 to be 
decoded followed by the subsequent pictures in ordinary decoding order, with the picture B4 
skipped. 

[0153] Where the picture for which an edit point is set is the picture P6 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture P6 of 
GOP(n) is the picture 13 of GOP(n). The decode scheduling unit 123 would then arrange for the 
picture 13 of GOP(n) to be decoded first followed by the subsequent pictures Bl, B2, P6, B4, B5, 
etc., of GOP(n) in decoding order. However, there is no need to decode the pictures Bl, B2, B4, 
and B5 located before the picture P6 with the edit point in order of display because the pictures 
Bl, B2, B4, and B5 are neither displayed nor referenced. Thus the decode scheduling unit 123 
arranges for the picture 13 of GOP(n) to be decoded first followed by the picture P6, with the 
pictures Bl and B2 skipped. The decode scheduling unit 123 further arranges for the picture P9 
to be decoded followed by the subsequent pictures in ordinary decoding order, with the pictures 
B4 and B5 skipped. 

[0154] Where the picture for which an edit point is set is the picture B7 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture B7 of 
GOP(n) are the pictures 13 and P6 of GOP(n). In this case, the decode scheduling unit 123 would 
arrange for the pictures 13 and P6 of GOP(n) to be decoded first followed by the subsequent 
pictures B4, B5, P9, B7, B8, etc., of GOP(n) in decoding order. However, there is no need to 
decode the pictures B4 and B5 located before the picture B7 with the edit point in order of 
display because the pictures B4 and B5 are neither displayed nor referenced. The decode 
scheduling unit 123 thus arranges for the picture P6 of GOP(n) to be decoded first followed by 
the picture P9, with the pictures B4 and B5 skipped. The decode scheduling unit 123 further 
arranges for the subsequent pictures to be decoded in ordinary decoding order. 

[0155] Where the picture for which an edit point is set is the picture B8 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture B8 of 
GOP(n) are the pictures 13 and P6 of GOP(n). The decode scheduling unit 123 would then 
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arrange for the pictures 13 and P6 of GOP(n) to be decoded first followed by the subsequent 
pictures B4, B5, P9, B7, B8, etc., of GOP(n) in decoding order. However, there is no need to 
decode the pictures B4, B5, and B7 located before the picture B8 with the edit point in order of 
display because the pictures B4, B5, and B7 are neither displayed nor referenced. Thus the 
decode scheduling unit 123 arranges for the picture P6 of GOP(n) to be decoded first followed 
by the picture P9, with the pictures B4 and B5 skipped. The decode scheduling unit 123 further 
arranges for the picture B 8 to be decoded followed by the subsequent pictures in ordinary 
decoding order, with the picture B7 skipped. 

[0156] Where the picture for which an edit point is set is the picture P9 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture P9 of 
GOP(n) are the pictures 13 and P6 of GOP(n). The decode scheduling unit 123 would then 
arrange for the pictures 13 and P6 of GOP(n) to be decoded first followed by the subsequent 
pictures B4, B5, P9, B7, B8, PI 2, BIO, Bl 1, etc., of GOP(n) in decoding order. However, there 
is no need to decode the pictures B4, B5, B7, and B8 located before the picture P9 with the edit 
point in order of display because the pictures B4, B5, B7, and B8 are neither displayed nor 
referenced. Thus the decode scheduling unit 123 arranges for the picture P6 of GOP(n) to be 
decoded first followed by the picture P9, with the pictures B4 and B5 skipped. The decode 
scheduling unit 123 further arranges for the picture PI 2 to be decoded followed by the 
subsequent pictures in ordinary decoding order, with the pictures B7 and B8 skipped. 

[0157] Where the picture for which an edit point is set is the picture BIO of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture BIO of 
GOP(n) are the pictures 13, P6, and P9 of GOP(n). The decode scheduling unit 123 would then 
arrange for the pictures 13, P6, and P9 of GOP(n) to be decoded first followed by the subsequent 
pictures B7, B8, PI 2, BIO, Bl 1 , etc., of GOP(n) in decoding order. However, there is no need to 
decode the pictures B7 and B8 located before the picture BIO with the edit point in order of 
display because the pictures B7 and B8 are neither displayed nor referenced. Thus the decode 
scheduling unit 123 arranges for the picture P9 of GOP(n) to be decoded first followed by the 
picture PI 2, with the pictures B7 and B8 skipped. The decode scheduling unit 123 further 
arranges for the subsequent pictures to be decoded in ordinary decoding order. 

[0158] Where the picture for which an edit point is set is the picture Bl 1 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture Bl 1 of 
GOP(n) are the pictures 13, P6, and P9 of GOP(n). The decode scheduling unit 123 would then 
arrange for the pictures 13, P6, and P9 of GOP(n) to be decoded first followed by the subsequent 
pictures B7, B8, P12, BIO, Bl 1, etc., of GOP(n) in decoding order. However, there is no need to 
decode the pictures B7, B8, and BIO located before the picture Bl 1 with the edit point in order 
of display because the pictures B7, B8, and BIO are neither displayed nor referenced. Thus the 
decode scheduling unit 123 arranges for the picture P9 of GOP(n) to be decoded first followed 
by the picture PI 2, with the pictures B7 and B8 skipped. The decode scheduling unit 123 further 
arranges for the picture Bl 1 to be decoded followed by the subsequent pictures in ordinary 
decoding order, with the picture BIO skipped. 

[0159] Where the picture for which an edit point is set is the picture PI 2 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture PI 2 of 
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GOP(n) are the pictures 13, P6, and P9 of GOP(n). The decode scheduling unit 123 would then 
arrange for the pictures 13, P6, and P9 of GOP(n) to be decoded first followed by the subsequent 
pictures B7, B8, PI 2, BIO, Bl 1, PI 5, PI 3, and B14 of GOP(n) as well as pictures of the next 
GOP in decoding order. However, there is no need to decode the pictures B7, B8, BIO, and Bl 1 
located before the picture PI 2 with the edit point in order of display because the pictures B7, B8, 
BIO, and Bl 1 are neither displayed nor referenced. Thus the decode scheduling unit 123 arranges 
for the picture P9 of GOP(n) to be decoded first followed by the picture PI 2, with the pictures 
B7 and B8 skipped. The decode scheduling unit 123 further arranges for the picture PI 5 to be 
decoded followed by the subsequent pictures in ordinary decoding order, with the pictures BIO 
and Bll skipped. 

[0160] Where the picture for which an edit point is set is the picture B13 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture B13 of 
GOP(n) are the pictures 13, P6, P9, and P12 of GOP(n). The decode scheduling unit 123 would 
then arrange for the pictures 13, P6, P9, and PI 2 of GOP(n) to be decoded first followed by the 
subsequent pictures BIO, B11,P15,B13, and B14 of GOP(n) as well as pictures of the next GOP 
in decoding order. However, there is no need to decode the pictures BIO and Bll located before 
the picture B13 with the edit point in order of display because the pictures BIO and Bl 1 are 
neither displayed nor referenced. Thus the decode scheduling unit 123 arranges for the picture 
P12 of GOP(n) to be decoded first followed by the picture P15, with the pictures BIO and Bl 1 
skipped. The decode scheduling unit 123 further arranges for the subsequent pictures to be 
decoded in ordinary decoding order. 

[0161] Where the picture for which an edit point is set is the picture B14 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture B14 of 
GOP(n) are the pictures 13, P6, P9, and P12 of GOP(n). The decode scheduling unit 123 would 
then arrange for the pictures 13, P6, P9, and P12 of GOP(n) to be decoded first followed by the 
subsequent pictures BIO, Bl 1, PI 5, B 13, and B 14 of GOP(n) as well as pictures of the next GOP 
in decoding order. However, there is no need to decode the pictures BIO, Bl 1, and B13 located 
before the picture B14 with the edit point in order of display because the pictures BIO, Bl 1, and 
B13 are neither displayed nor referenced. Thus the decode scheduling unit 123 arranges for the 
picture P12 of GOP(n) to be decoded first followed by the picture PI 5, with the pictures BIO and 
Bl 1 skipped. The decode scheduling unit 123 further arranges for the picture B 14 to be decoded 
followed by the subsequent pictures in ordinary decoding order, with the picture B13 skipped. 

[0162] Where the picture for which an edit point is set is the picture PI 5 of GOP(n), a minimum 
of undisplayed but necessary pictures to be decoded preparatory to decoding the picture PI 5 of 
GOP(n) are the pictures 13, P6, P9, and PI 2 of GOP(n). The decode scheduling unit 123 would 
then arrange for the pictures 13, P6, P9, and PI 2 of GOP(n) to be decoded first followed by the 
subsequent pictures BIO, Bl 1, PI 5, B 13, and B14 of GOP(n) as well as pictures of the next GOP 
in decoding order. However, there is no need to decode the pictures BIO, Bl 1, B13, and B14 
located before the picture PI 5 with the edit point in order of display because the pictures BIO, 
Bl 1, B13, and B 14 are neither displayed nor referenced. Thus the decode scheduling unit 123 
arranges for the picture P12 of GOP(n) to be decoded first followed by the picture PI 5, with the 
pictures BIO and Bl 1 skipped. The decode scheduling unit 123 further arranges for the next 
GOP (starting with a picture 13) to be decoded followed by the subsequent pictures in ordinary 
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decoding order, with the pictures B13 and B14 skipped. 

[0163] As described, depending on the type of a picture, which is reached for decoding and for 
which an edit point (IN point) is found set, the number of pictures required to be decoded for 
reference before decoding that picture varies. When and where to start decoding a given picture 
is thus determined by the number of pictures to be decoded in advance of the picture. 

[0164] Suppose that, as shown in FIG. 9A, a display of AV data is to be made from a given point 
GOP.sub.i of the data to a picture P6 of GOP(m) for which an OUT.sub.l point is set, from a 
picture Bl of GOP(n) for which an IN.sub.2 point is set to a picture P6 of GOP(n) for which an 
OUT.sub.2 point is set, and from a picture Bl of GOP(m+2) for which an IN.sub.3 point is set to 
subsequent pictures. In that case, the decode starting time and decode starting location are 
determined for each of the decoders 155.sub.l and 155.sub.2 as described below. 

[0165] The decode scheduling unit 123 initially causes one of the two decoders (e.g., decoder 
155.sub.l) to decode pictures 13, Bl, B2, P6, B4, and B5 of GOP(m) for display, as indicated in 
FIG. 9B. 

[0166] Where the pictures 13, Bl, B2, P6, B4, and B5 of GOP(m) are decoded, the decoding of 
the last picture B5 of GOP(m) is required to be complete before a time t.sub.n-2 at which to 
display the picture B5. Given that requirement, the time at which to start decoding GOP(m) is set 
to a time t.sub.n-8, earlier than the time t.sub.n-2 by the length of time during which to display 
the pictures Bl through P6 of GOP(m). 

[0167] In FIGS. 9A, 9B, and 9C, a time t.sub.n denotes the time at which the first picture Bl of 
GOP(n) starts being displayed (i.e., the time at which the display of the picture P6 of GOP(m) 
ends). A time t.sub.n-i represents the time earlier than the time T.sub.n by the length of time 
during which to display "i" frames. 

[0168] After the pictures Bl through P6 of GOP(m) have been decoded by the decoder 155.sub.l 
and displayed, the OUT.sub. 1 point is reached as shown in FIG. 9A. It then becomes necessary 
to decode and display the pictures Bl through P6 of GOP(n) starting at the IN.sub.2 point and 
ending at the OUT.sub.2 point. 

[0169] It is the picture Bl of GOP(n) for which the IN.sub.2 point is set. Thus the decode 
scheduling unit 123 causes the other decoder 155. sub. 2 to decode pictures 13, P6, P9, P12, and 
P15 of GOP(n-l) preceding GOP(n) and then to decode pictures 13, Bl, B2, P6, B4, and B5 of 
GOP(n), as shown in FIG. 9C. The decoding procedure involved is as discussed above with 
reference to FIG. 8. As a result, the decode starting location is set to the picture 13 of GOP(n-l). 

[0170] Where the pictures 13, Bl, B2, P6, B4, and B5 of GOP(n) are decoded, the decoding of 
the picture Bl for which the IN.sub.2 point is set is required to be complete before the time 
t.sub.n at which the picture Bl is to be displayed. Given that requirement, the decode scheduling 
unit 123 determines for the decoder 155.sub.2 a decode starting time such that the decoder starts 
decoding the picture 13 of GOP(n-l), seven pictures earlier than the picture Bl of GOP(n), 
before a time t.sub.n-7 that is earlier than the time t.sub.n by the length of time during which to 



21 



00402152 



PATENT 

Substitute Specification (Showing Changes) 

display seven pictures. 

[0171] Meanwhile, the decoder 155.sub.l decodes the pictures 13, Bl, B2, P6, B4, and B5 of 
GOP(m) before terminating its decoding process. After the decoder 155.sub.2 has decoded the 
picture B5 of GOP(n) and the previously decoded picture P6 has been displayed, the OUT.sub.2 
point is reached as shown in FIG. 9A. Then GOP(m+2) starting at the IN.sub.3 point and 
subsequent GOP f s must be decoded and displayed. 

[0172] Since the IN.sub.3 point is set for the picture Bl of GOP(m+2), the decode scheduling 
unit 123 causes the decoder 155.sub.l to decode the pictures 13, P6, P9, P12, and PI 5 of 
GOP(m+l) preceding GOP(m+2) and then to decode the pictures 13, Bl, B2, P6, B4, B5, etc., of 
GOP(m+2), as shown in FIG. 9B. The decoding procedure involved is as discussed above with 
reference to FIG. 8. Thus the decode scheduling unit 123 sets the decode starting location to the 
picture 13 of GOP(m+l) for the decoder 1551. 

[0173] Where GOP(m+2) is decoded, the picture Bl for which the IN.sub.3 point is set needs to 
have been decoded before its display time t'.sub.n. Thus the decode scheduling unit 123 
determines for the decoder 155.sub.l a decode starting time such that the decoder starts decoding 
the picture 13 of GOP(m+l), seven pictures earlier than the picture Bl of GOP(m+2), before a 
time T f .sub.n-7 that is earlier than the time t'.sub.n by the length of time during which to display 
seven pictures. 

[0174] In FIGS. 9A, 9B, and 9C, the time t'.sub.n denotes the time at which to start displaying 
the first picture Bl of GOP(m+2)(i.e., the time at which display of the picture P6 of GOP(n) 
ends). A time t'.sub.n-i represents the time earlier than the time t'.sub.n by the length of time 
during which to display as many as "i" frames. 

[0175] As described above, the decode scheduling unit 123 calculates the number of pictures that 
need to be decoded before displaying a given picture for which an edit point is set, and 
establishes the first of the pictures to be decoded beforehand as the decode starting point. The 
decode scheduling unit 123 then establishes the decode starting time as a point in time earlier 
than the time at which to display the picture with the edit point, by the length of time during 
which to decode the calculated number of pictures. 

[0176] FIG. 10 is a schematic view illustratively showing the number of pictures to be decoded 
before displaying each of the pictures for which edit points are set. As shown in FIG. 10, the 
number of pictures that need to be decoded before displaying a given picture for which an edit 
point is set corresponds to the number of I and P pictures that exist between the picture with the 
edit point and the most recent I picture encountered. In FIG. 10, where the picture for which an 
edit point is set is an I picture or a P picture, the number of I and P pictures between that picture 
with the edit point (inclusive) and the most recent I picture is assumed to be represented by Nip. 

[0177] Illustratively, where an edit point is set for a picture Bl or B2 of GOP(n) in FIG. 10, there 
are six pictures to be decoded, i.e., pictures 13, P6, P9, P12, and P15 of GOP(n-l) and a picture 
13 of GOP(n), preparatory to decoding the picture Bl or B2. In this case, the number Nip is 6. 
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[0178] Where an edit point is set for the picture 13 of GOP(n), there is no need to reference other 
pictures preparatory to decoding the picture 13, In this case, the number Nip is 1, representing the 
picture 13 itself. 

[0179] Where an edit point is set for a picture B4 or B5 of GOP(n), there are two pictures to be 
decoded, i.e., pictures 13 and P6 of GOP(n), preparatory to decoding the picture B4 or B5. In this 
case, the number Nip is 2. 

[01 80] Where an edit point is set for the picture P6 of GOP(n), the picture 13 of GOP(n) needs to 
be decoded preparatory to decoding the picture P6. In this case, the number Nip is 2, 
representing the picture 13 plus the picture P6. 

[0181] Where an edit point is set for a picture B7 or B8 of GOP(n), there are three pictures to be 
decoded, i.e., pictures 13, P6, and P9 of GOP(n), preparatory to decoding the picture B7 or B8. 
Thus the number Nip is 3. 

[01 82] Where an edit point is set for the picture P9 of GOP(n), there are two pictures to be 
decoded, i.e., pictures 13 and P6 of GOP(n), preparatory to decoding the picture P9. Then the 
number Nip is 3, representing the two pictures plus the picture P9 itself. 

[0183] Where an edit point is set for a picture B10 or Bl 1 of GOP(n), there are four pictures to 
be decoded, i.e., pictures 13, P6, P9, and P12 of GOP(n), preparatory to decoding the picture B10 
or Bl 1 . Thus the number Nip is 4. 

[0184] Where an edit point is set for the picture P12 of GOP(n), there are three pictures to be 
decoded, i.e., pictures 13, P6, and P9 of GOP(n), preparatory to decoding the picture P12. In this 
case, the number Nip is 4, representing the three pictures plus the picture PI 2 itself. 

[0185] Where an edit point is set for a picture B13 or B14, there are five pictures to be decoded, 
i.e., pictures 13, P6, P9, P12, and P15 of GOP(n), preparatory to decoding the picture B13 or 
B14. Thus the number Nip is 5. 

[0186] Where an edit point is set for the picture PI 5 of GOP(n), there are four pictures to be 
decoded, i.e., pictures 13, P6, P9, and PI 2 of GOP(n), preparatory to decoding the picture PI 5. 
Then the number Nip is 5, representing the four pictures plus the picture PI 5 itself. 

[0187] FIG. 1 1 is a schematic view indicating typical conditions for decode scheduling. It is 
assumed here that EP(n-l) denotes the location of an edit point n-1 preceding an edit point n; and 
that a clip A stands for the clip having an OUT point at EP(n-l), a clip B for the clip having an 
OUT point at EP(n), and a clip C for the clip having an IN point at EP(n). It is also assumed that 
P(n) represents the number of pictures to be displayed out of the clip B and that the above- 
mentioned number Nip denotes the number of pictures to be decoded preparatory to displaying 
that picture of the clip C for which the IN point is set. 

[0188] In the case above, the reproducing apparatus 101 having two decoders (such as the one 
shown in FIG. 7) performs its decode scheduling in such a manner as to meet the different 
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conditions below depending on whether the clip A and clip C are different or the same. 
[0189] (1) Where the clip A and clip C are different, the condition 
P(n).gtoreq.Nip 

[0190] should be met. More specifically, if the clip A and clip C are different, it is necessary for 
one of the two decoders to decode "P(n) n pictures and for the other decoder to decode parallelly 
"Nip" pictures before displaying that picture of the clip C for which the IN point is set. Decode 
scheduling is made so as to meet that requirement. 

[0191] (2) Where the clip A and clip C are in fact the same clip, one of two conditions (a) and (b) 
below should be met. 

[0192] (a) The time difference between the IN point of the clip C and the OUT point of the clip 
A should be shorter than the display time of P(n). 

[0193] More specifically, given that the clip A and clip C are in fact the same clip, if the time 
difference between the IN point of the clip C and the OUT point of the clip A is shorter than the 
display time of P(n), then it is possible to decode pictures continuously from the OUT point of 
the clip A through the IN point of the clip C (inclusive) without triggering a seek from the OUT 
point to the IN point so that decoding of the picture of the clip C for which the IN point is set 
will have ended by the time that picture is to be displayed. 

[0194] (b) If the condition (a) above is not met, then the condition (1) above should be satisfied. 

[0195] If the time difference between the IN point of the clip C and the OUT point of the clip A 
is longer than the display time of P(n), then it is necessary to decode "Nip" pictures before 
displaying that picture of the clip C for which the IN point is set, as mentioned above. 

[0196] The reproducing apparatus 101 carries out decode scheduling in the manner described 
above, decoding AV data in accordance with schedule information representative of the results 
of the scheduling. Implementing such decode scheduling averts the freeze of displayed pictures 
(e.g., state of FIG. 1C) and thereby ensures real-time reproduction. 

[0197] In the foregoing description, the reproducing apparatus 101 was shown having two 
decoders of a standard decoding speed capability each. If three or more decoders are provided, 
the picture count P(n) is defined as 

P(n)=EP(n)-EP(n-DN+l) 

[0198] where DN stands for the number of decoders. In this case, the condition (1) above is 
modified into 

P(n).gtoreq.Nip/DS 
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[0199] where DS represents the decoding speed. 

[0200] How the disc apparatus 1 and reproducing apparatus 101 of the structures explained 
above operate will now be described with reference to the accompanying flowcharts. 

[0201] Described first with reference to the flowcharts of FIGS. 12 and 13 is a play list creating 
process performed by the disc apparatus 1 of FIG. 2. 

[0202] Illustratively, the play list creating process is carried out when the optical disc 52 with 
AV data and edit lists recorded thereon is loaded into the drive 12 and a relevant edit list is 
selected from among the recorded edit lists for conversion into a play list. 

[0203] In step SI of FIG. 12 5 the edit list reading unit 42 reads and interprets an edit list that is 
recorded on the optical disc 52. More specifically, the edit list reading unit 42 reads an edit list 
such as one shown in FIG. 14 from the disc and converts the retrieved edit list into a format that 
can be processed by the information processing block 1 1 . 

[0204] FIG. 14 shows a partial code structure of a typical edit list ranging from a <body> tag, 
which is a starting tag, to another <body> tag, an ending tag. In FIG. 14, each of the lines shown 
is prefixed with a number and a colon (:) symbol. These numbers and symbols are provided for 
purpose of explanation and are not part of the code. The same applies to FIGS. 18, 19, 26, 31, 
and 34 as well. 

[0205] As mentioned above, the edit list represents edit point locations (time code). A typical list 
content is described from a <par> tag on line 2 to </par> tag on line 12 in FIG. 14. 

[0206] A notation [<!— Clipl— >] on line 3 indicates that a code regarding a clip #1 is described 
on lines 4 and 5. 

[0207] Of the notations on lines 4 and 5 made up of [<ref src- f urn:smpte:umid:XX . . . VA" 
clipBegin= M smpte=00:00:00:00 n clipEnd= M smpte-00:05:00:127>], the portion [ref 
src- 'urn:smpte:umid:XX . . . VA"] indicates that the portion [umid:XX . . . VA](file name of 
clip #1) defined by SMPTE (Society of Motion Picture and Television Engineers) standards is to 
be an object of reproduction. The portion [clipBegin =M smpte=00:00:00:00 M ] indicates that an IN 
point of the clip #1 is set to [TC=00:00:00:00] with reference to a given point in time. The 
portion [clipEnd="smpte=00:05:00:12 n ] indicates that an OUT point of the clip #1 is set to 
[TC=00:05:00:12]. 

[0208] The term "umid" (unique material identifier) represents a unique ID, the one and only in 
the world, given to a data item to be referenced. There are two types of umid (UMID): Basic 
UMID and Extended UMID. The Basic UMID constitutes a unique ID given to AV data or other 
materials. The Extended UMID forms an attachment to the Basic UMID and represents a source 
pack (e.g., time, location, name of the person who obtained data, etc.). As such, the Extended 
UMID is used to denote characteristics of pictures or to be referenced for search purposes. 

[0209] A notation [<!~Clip2-->] on line 6 indicates that a code regarding a clip #2 is described 
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below on lines 7 and 8. 

[0210] Of the notations on lines 7 and 8 made up of [<ref src="um:smpte:umid:YY . . . VA" 
begin="smpte=00:05:00:12" clipBegin="smpte=00:02:00:00" clipEnd="smpte=00:02:00:107>], 
the portion [ref src="urn:smpte:umid: YY . . . VA"] indicates that the file name of the clip #2 is 
[umid:YY . . . VA]. The portion [begin="smpte=00:05:00:12"] indicates that reproduction of the 
clip #2 is to begin at [TC=00:05:00:12]. 

[021 1] The portion [clipBegin="smpte:00:02:00:00 M ] indicates that an IN point of the clip #2 is 
set to [TC=00:02:00:00]. The portion [clipEnd= n smpte:00:02:00:10 M ] indicates that an OUT 
point of the clip #2 is set to [TC=00:02:00:10]. 

[0212] A notation [<!— Clip3— >] on line 9 indicates that a code regarding a clip #3 is described 
below on lines 1 0 and 1 1 . 

[0213] Of the notations on lines 10 and 1 1 made up of [<ref src- ! um:smpte:umid:ZZ . . . VA M 
begin="smpte=00:05:00:22" clipBegin="smpte=00:10:00:037>], the portion [ref 
src="urn:smpte:umid:ZZ . . . VA M ] indicates that the file name of the clip #3 is [umid:ZZ . . . 
VA]. The portion [begin- 'smpte=00:05:00:22"] indicates that reproduction of the clip #3 is to 
begin at [TC=00:05:00:22]. 

[0214] The portion [clipBegin= M smpte=00: 10:00:03"] indicates that an IN point of the clip #3 is 
set to [TO00: 10:00:03]. 

[0215] As described, the edit list recorded on the optical disc 52 and a play list created on the 
basis of that list are described illustratively in an XML-based edit description language. 

[0216] The edit list retrieved by the edit list reading unit 42 is converted to a predetermined 
format. The edit list thus converted is output to the picture pointer reading unit 41 . 

[0217] In step S2, given the edit list from the edit list reading unit 42, the picture pointer reading 
unit 41 reads from the optical disc 52 the picture pointers for the clips to be referenced in that 
edit list. For example, if the edit list reading unit 42 supplies the picture pointer reading unit 41 
with the edit list of FIG. 14 referencing the clips #1 through #3, then the picture pointer reading 
unit 41 acquires the picture pointers for the clips #1 through #3. 

[021 8] FIG. 15 is a tabular view showing typical picture pointers. A table of information shown 
in FIG. 15 is created as a picture pointer illustratively for each clip at the time of recording (i.e., 
encoding) AV data and is recorded onto the optical disc 52. This table is constituted by a 
plurality of entries of a fixed size each. In the example of FIG. 15, each entry is eight bytes long. 

[0219] One entry accommodates information about one picture. The entries hold information 
about pictures in the order in which they are to be displayed. 

[0220] The information about each picture is prefixed with a GOP starting flag, a top_field first 
flag, and a repeat_first_field flag of one bit each. In the example of FIG. 15, a GOP starting flag 
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"1" indicates that the corresponding picture is located at the beginning of the GOP in question; a 
GOP starting flag "0" indicates that the corresponding picture is not at the beginning of the GOP. 

[0221] The three flags above are followed by a data size field that records the size of each picture 
in 21 bits. 

[0222] The data size field is followed by a picture type field describing the type of the 
corresponding picture in three bits. A picture type "001 " indicates that the picture in question is 
an I picture; a picture type "010" indicates that the picture is a P picture; a picture type "01 1 " 
indicates that the picture is a B picture; and a picture type "000" indicates that the picture is a 
dummy picture. 

[0223] The picture type field is followed by a file address field describing in 37 bits a starting 
file address (logical address) of the picture in question. 

[0224] The picture pointers retrieved by the picture pointer reading unit 41 are output to the real- 
time reproduction feasibility determining unit 24 together with the edit list. 

[0225] In order to determine whether the reproducing apparatus 101 can reproduce AV data in 
real time, the real-time reproduction feasibility determining unit 24 needs the physical address of 
each picture on the optical disc 52. Thus the real-time reproduction feasibility determining unit 
24 outputs to the address managing unit 23 the file addresses (i.e., logical addresses) described in 
the picture pointers fed from the picture pointer reading unit 41 . 

[0226] In step S3, the address managing unit 23 converts each logical address coming from the 
real-time reproduction feasibility determining unit 24 into a physical address, and sends the 
acquired physical address back to the real-time reproduction feasibility determining unit 24. 

[0227] The real-time reproduction feasibility determining unit 24 acquires the physical address 
(of each picture) from the address managing unit 23. In step S4, the real-time reproduction 
feasibility determining unit 24 determines whether the reproducing apparatus 101 can reproduce 
in real time each AV data item referenced in the edit list in accordance with the edit point of the 
data item (i.e., real-time reproduction feasibility is determined here). The determination of real- 
time reproduction feasibility in step S4 is carried out for each of all locations where a seek is 
predicted to occur. 

[0228] At this point, the real-time reproduction feasibility determining unit 24 is being supplied 
with such information as the buffer size and decoding speed of the reproducing apparatus 101 
from the device information storing unit 25. The information is utilized as a basis for 
determining the feasibility of real-time reproduction. 

[0229] Details about techniques of determining real-time reproduction feasibility are disclosed 
illustratively in Japanese Patent Applications Nos. 2002-366197 and 2002-366199. The 
techniques described in these applications may be applied to the determination of real-time 
reproduction feasibility carried out by the disc apparatus 1 of FIG. 2. Obviously, other diverse 
techniques may be adopted instead. One such technique would involve having AV data 
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reproduced in virtual fashion under the same conditions as those of the reproducing apparatus 
101 so that the real-time reproduction feasibility determining unit 24 may determine whether the 
virtual reproduction can be performed by the reproducing apparatus 101 in real time. 

[0230] In step S5, the real-time reproduction feasibility determining unit 24 determines whether 
it is necessary to create any bridge clip based on the result of the determination of real-time 
reproduction feasibility. 

[0231] If the seek time involved is found to be too long for the reproducing apparatus 101 to 
perform real-time reproduction in keeping with the edit list, as described above with reference to 
FIGS. 3 A and 3B, the real-time reproduction feasibility determining unit 24 determines in step 
S5 that bridge clips need to be created. From step S5, the real-time reproduction feasibility 
determining unit 24 goes to step S6. At this point, such information as the edit list, picture 
pointers, and the physical address of each picture is output to the bridge clip creating unit 26 
through the control unit 22. 

[0232] In step S6, the bridge clip creating unit 26 determines the locations at which to create 
bridge clips in accordance with the result of the determination of real-time reproduction 
feasibility. 

[0233] In step S7, the bridge clip creating unit 26 creates bridge clips illustratively in units of 
GOP's at the locations determined in step S6. 

[0234] FIGS. 16 and 17 show typical orders in which a bridge clip is created. Hollow arrows in 
FIG. 16 indicate a typical order in which pictures are displayed. More specifically, picture 
display proceeds first from a GOP.sub.i to the picture of GOP(m+2) for which an OUT.sub.l 
point is set, then from the picture of GOP(n) for which an IN.sub.2 point is set to the picture of 
GOP(n) for which an OUT.sub.2 point is set, and from the picture of GOP(o) for which an 
IN.sub.3 point is set to subsequent pictures of GOP.sub.j. 

[0235] In the example of FIG. 16, if the starting location of GOP.sub.i is assumed to be 
[TC=00:00:00:00], then the beginning of GOP(m+2) is defined as [TC=00:05:00:00]. The 
OUT.sub.l point is set to [TC=00:05:00:12], IN.sub.2 point to [TC=00:02:00:00], OUT.sub.2 
point to [TC=00:02:00:10], and IN.sub.3 point to [TC=00: 10:00:03]. It follows that the IN.sub.2 
and OUT.sub.2 points are located temporally before the OUT.sub.l point and that the IN.sub.3 
point is located temporally after the OUT.sub.l point. In other words, the display in the example 
of FIG. 16 is based on the edit list of FIG. 14. 

[0236] Illustratively, suppose the real-time reproduction feasibility determining unit 24 
determines that the seek time between the OUT.sub.l point and the IN.sub.2 point or between 
the OUT.sub.2 point and the IN.sub.3 point is too long for the reproducing apparatus 101 to 
reproduce the clips in real time in the order indicated by the hollow arrows in FIG. 16. In that 
case, the bridge clip creating unit 26 creates a bridge clip made up of GOP(m+2) of the clip #1, 
GOP(n) of the clip #2, and GOP(o) of the clip #3 as shown in FIG. 1 7, in a blank area of the 
optical disc 52. 
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[0237] In the example of FIG. 17, if the beginning of GOP(m+2) is assumed to be 
[TC=00:00:00:00], then the OUT.sub.l point set for GOP(m+2) is defined as [TC=00:00:00:12]. 
On that assumption, the IN.sub.2 and OUT.sub.2 points set for GOP(n) are defined as 
[TC=00:00:00:17] and [TC=00:00:00:27] respectively. The IN.sub.3 point set for GOP(o) is 
defined as [TC=00:00:01 :03] and the ending location of GOP(o) as [TC=00:00:01 :14]. 

[0238] Bridge clips are created in the manner described above for all locations where these clips 
are deemed necessary (i.e., locations where the seek time involved is inordinately long). The edit 
list is then modified so that the AV data will be reproduced in reference to the created bridge 
clips. 

[0239] The bridge clips created by the bridge clip creating unit 26 are output to the write unit 3 1 
and written thereby to the optical disc 52 via the disc interface 5 1 . Bridge clip-related 
information such as the locations where the bridge clips are created and the file names of the 
bridge clips is output to the play list creating unit 28 and picture pointer creating unit 29. 

[0240] In step S8, the bridge clip creating unit 26 determines whether bridge clips have been 
created for all locations. If bridge clips have yet to be created for all locations, step S7 is reached 
again and the bridge clip creating unit 26 creates more bridge clips for the necessary locations. 

[0241] If in step S8 the bridge clip creating unit 26 determines that the bridge clips have been 
created for all locations, control is passed on to step S9 in FIG. 13. In step S9, the picture pointer 
creating unit 29 creates picture pointers for the bridge clips. More specifically, given the picture 
pointers from the control unit 22 (i.e., picture pointers read by the picture pointer reading unit 41 
for the clips to be referenced in the edit list), the picture pointer creating unit 29 extracts 
therefrom solely information about the pictures making up the bridge clips. The extracted 
information constitutes the picture pointers for the bridge clips. The picture pointers created in 
this step are part of the picture pointers that are created later in step SI 3. 

[0242] In step S10, the play list creating unit 28 modifies the edit list supplied from the control 
unit 22 into a play list in such a manner that data will be reproduced by referencing the bridge 
clips. 

[0243] FIG. 18 shows a typical play list obtained by modifying the edit list of FIG. 14 in such a 
manner that the bridge clip in FIG. 17 will be referenced. In explaining the edit list of FIG. 18 
below, descriptions of the portions that were also found in FIG. 14 may be omitted where 
redundant. 

[0244] Lines 3 through 5 in FIG. 18 constitute a code regarding the clip #1 (Clipl); lines 6 
through 12 make up a code regarding a newly created bridge clip (Bridge Clip); and lines 13 
through 1 5 form a code regarding the clip #3 (Clip3). In this play list, the newly created bridge 
clip is the object to be reproduced. 

[0245] More specifically, lines 4 and 5 in FIG. 18 with [<ref src="urn:smpte:umid:XX . . . VA" 
clipBegin= M smpte:00:00:00:00" clipEnd= M smpte=00:05:00:00 M />] indicate that the clip #1 
designated by [umid:XX . . . VA] is to be reproduced from [TC=00:00:00:00] to 
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[TC=00:05:00:00] (i.e., from GOP.sub.i, not shown, to the last picture of GOP(m+l) in FIG. 16). 

[0246] Line 6 with [<!?--Bridge Clip— >] indicates that a code regarding the bridge clip is 
described from line 7 through line 12. 

[0247] Line 7 with <ref src="urn:smpte:umid:AA . . . VA" begin="smpte=00:05:00:00 n ] 
indicates that reproduction of the bridge clip designated by [umidrAA . . . VA] is to begin at 
[TC=00:05:00:00]. 

[0248] Line 8 with [clipBegin="smpte=00:00:00:00 M clipEnd= n smpte=00:00:00:- 12"/] indicates 
that the pictures ranging from [TC=00:00:00:00] to [TC=00:00:00:12] (i.e., the first picture of 
GOP(m+2) through the picture of the OUT.sub.l point (FIG. 17) therein constituting part of the 
bridge clip) are to be reproduced with reference to a point in time within the bridge clip. 

[0249] Line 9 with [<ref src="um:smpte:umid:AA . . . VA" begin="smpte=00:05:00:12 n ] 
indicates that reproduction of the portion designated by a code on line 10 is to begin at 
[TC=00:05:00:12]. ^ 

[0250] Line 10 with [clipBegin= n smpte=00:00:00:17 M clipEnd= M smpte=00:00:00> 277] indicates 
that the pictures ranging from [TC=00:00:00:17] to [TC=00:00:00:27](i.e., pictures from the 
IN.sub.2 point to the OUT.sub.2 point (FIG. 17) constituting part of the bridge clip) are to be 
reproduced with reference to a point in time within the bridge clip. 

[0251] Line 11 with [<ref src="urn:smpte:umid:AA . . . VA" begin="smpte=00:05:00:22 M ] 
indicates that reproduction of the portion designated by a code on line 12 is to begin at 
[TC=00:05:00:22]. 

[0252] Line 12 with [clipBegin= n smpte=00:00:01:03 n clipEnd= M smpte=00:00:01- :147] 
indicates that the pictures ranging from [TC=00:00:01:03] to [TC=00:00:01:14] (i.e., pictures 
from the IN.sub.3 point to the last picture in GOP(o) (FIG. 17) constituting part of the bridge 
clip) are to be reproduced with reference to a point in time within the bridge clip. 

[0253] The play list created by the play list creating unit 28 is output to the picture pointer 
creating unit 29 and write unit 3 1 . 

[0254] FIG. 19 is a schematic view of another typical play list created in step S10 of FIG. 13 on 
the basis of the edit list in FIG. 14. The play list of FIG. 19 differs from that of FIG. 18 in terms 
of how files are referenced. 

[0255] More specifically, in the play list of FIG. 19, line 4 with [" . . . /0001/videoOl.mpg"] 
designates the clip #1. Lines 7, 9, and 1 1 with [" . . . /Edit/0002/video02.mpg"] designate the 
bridge clip. Line 13 with [" . . . /0005/video05.mpg M ] designates the clip #3. As described, the 
play list creating unit 28 is capable of describing play lists so that clips may be designated in 
diverse formats. 

[0256] Returning to the explanation of FIG. 13, the play list creating unit 28 checks in step SI 1 
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to see whether it is necessary to supplement the play list created in step S10 with additional 
information created by the additional information creating unit 27. If it is deemed necessary to 
furnish additional information, step S12 is reached. 

[0257] In step SI 2, the play list creating unit 28 supplements the play list with the additional 
information created by the additional information creating unit 27. The addition information 
illustratively includes schedule information and decode designation information, as will be 
discussed later. 

[0258] If it is not deemed necessary to furnish additional information in step SI 1, step S12 is 
skipped. 

[0259] In step SI 3, the picture pointer creating unit 29 creates the picture pointers for the clips to 
be referenced in the play list. For example, the picture pointer creating unit 29 supplements the 
picture pointers created in step S9 for the bridge clips with the picture pointers for those clips 
other than the bridge clips, which are also referenced in the play list. The picture pointers thus 
acquired make up the picture pointers of the play list. The picture pointers having been created as 
described by the picture pointer creating unit 29 are output to the write unit 3 1 . 

[0260] In step SI 4, the write unit 31 writes the play list coming from the play list creating unit 28 
as well as the picture pointers from the picture pointer creating unit 29 to suitable areas on the 
optical disc 52 through the disc interface 51. After the write operation, the play list creating 
process is terminated. 

[0261] If it is deemed unnecessary to create bridge clips in step S5 of FIG. 12, then step SI 5 is 
reached. In step SI 5, the unmodified edit list is regarded as a play list. Step SI 5 is followed by 
step SI 1 and subsequent steps. In other words, if the reproducing apparatus 101 can reproduce 
AV data in real time by referring to the edit list, then bridge clips are not created. In that case, the 
play list is created in such a manner that the clips referenced in the unmodified edit list become 
the objects to be reproduced. 

[0262] When the reproducing apparatus 101 is supplied with a play list created to ensure real- 
time reproduction of AV data, the apparatus 101 reproduces the AV data in real time in keeping 
with the created play list. This prevents any freeze during reproduction stemming from an 
inordinately long seek time that would arise without recourse to such a play list. 

[0263] Described below with reference to the flowchart of FIG. 20 is an AV data reproducing 
process performed by the reproducing apparatus 101 in accordance with the play list created 
through the processing outlined in FIGS. 12 and 13. 

[0264] The optical disc 52 with a play list recorded thereon is first loaded into the drive 112. 
When an instruction is given to reproduce AV data in keeping with the play list, the play list 
reading unit 132 reaches step S31, reads the play list from the optical disc 52, and interprets the 
retrieved list illustratively for conversion to an internally processible format. The play list 
retrieved and interpreted by the play list reading unit 132 is output to the picture pointer reading 
unit 131. 
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[0265] For example, the play list reading unit 132 reads from the disc the play list shown in FIG. 
18 or the play list in FIG. 19. 

[0266] In step S32, the picture pointer reading unit 131 reads from the optical disc 52 the picture 
pointers for the clips to be referenced in the play list. The picture pointers thus read by the 
picture pointer reading unit 131 are output to the decode scheduling unit 123 along with the play 
list. 

[0267] In step S33, the decode scheduling unit 123 schedules decode starting locations and 
decode starting times for the AV data based on the play list and picture pointers coming from the 
picture pointer reading unit 131. 

[0268] More specifically, the decode scheduling unit 123 detects from the play list the pictures 
for which edit points (IN points) are set, and acquires the picture types of the detected pictures 
from the picture pointers. As discussed earlier with reference to FIGS. 8 through 9C, the decode 
scheduling unit 123 acquires the number of pictures to be decoded preparatory to decoding each 
picture for which an edit point is set, and determines a decode starting location (for the picture in 
question) and a decode starting time accordingly. 

[0269] In step S34, the decode scheduling unit 123 causes the decoder selecting unit 133 to 
select the decoder that will carry out the decoding. 

[0270] In step S35, the decode scheduling unit 123 acquires from the picture pointers the file 
addresses of the clips to be referenced in the play list. In step S36, the decode scheduling unit 
123 acquires the physical addresses of the pictures corresponding to the file addresses by 
querying the address managing unit 122. 

[0271] It is the decoder controlling unit 124 that is supplied with such information as schedule 
information derived from the scheduling performed by the decode scheduling unit 123, decoder 
designation information, and physical addresses of the clips-to be referenced. 

[0272] The reproducing apparatus 101 of FIG. 6 performs preprocessing for AV data 
reproduction in three major stages: scheduling of decode starting locations and decode starting 
times (step S33), selection of the decoder (step S34), and acquisition of physical addresses (step 
S36). 

[0273] In step S3 7, the decoder controlling unit 124 reproduces the AV data by controlling the 
decoders 155.sub.l and 155.sub.2 in keeping with the schedule information and decoder 
designation information. 

[0274] In step S38, the decoder controlling unit 124 determines whether the user has effected a 
stop operation. If the stop operation is not found to be carried out, step S39 is reached. In step 
S39, the decoder controlling unit 124 determines whether reproduction of the AV data is set to 
be terminated according to the play list. 
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[0275] If in step S39 the decoder controlling unit 124 determines that reproduction of the AV 
data is not set to be terminated, the controlling unit 124 goes back to step S37 and repeats the 
subsequent steps. If reproduction of the AV data is found set to be terminated, then the data 
reproduction is brought to an end. The reproduction is also terminated if the stop operation is 
found to be performed in step S3 8. 

[0276] FIG. 21 schematically shows how AV data are reproduced in step S37 of FIG. 20 when 
the play list of FIG. 19 is provided. In FIG. 21, the order of display is indicated by hollow 
arrows; the order of decoding (i.e., reproduction) by the decoder 155.sub.l is represented by 
solid-line arrows across AV data (GOP's); and the order of decoding by the decoder 155.sub.2 is 
denoted by broken-line arrows across the AV data. 

[0277] Illustratively, according to the description of lines 4 and 5 in FIG. 19, the decoder 
155.sub.l selected in the above-described process (step S34) decodes pictures ranging from 
[TC=00:00:00:00] to [TC=00:05:00:00] in a clip #1 designated by [" . . . /0001/videoOl.mpg"] 
(i.e., the first picture of GOP.sub.i through the last picture of GOP(m+l)), as shown in FIG. 21 . 

[0278] Following the last picture of GOP(m+l)(at TC=00:05:00:00) and based on the description 
of lines 7 and 8 in FIG. 19, the decoder 155.sub.l decodes pictures ranging from 
[TC=00:00:00:00] to [TC=00:00:00:12] in a bridge clip designated by [" .../.. . 
/Edit/0002/video02.mpg"] (i.e., the first picture through the picture for which an OUT.sub.l 
point is set in GOP(m+2)). 

[0279] If the reproduction starting time [TC-00:00:00:00] for the clip #1 is taken as the 
reference, the OUT.sub.l point is defined as [TC=00:05:00:00] at which decoding of the last 
picture of GOP(m+l) is to end, plus a period of time [00:00:00:12] ranging from the beginning 
of GOP(m+2) to the OUT.sub.l point in the bridge clip. That is, the OUT.sub.l point is located 
at[TC=00:05:00:12]. 

[0280] Following the decoding of the picture for which the OUT.sub.l point is set [at 
TC=00:05:00:12] and based on the description of lines 9 and 10 in FIG. 19, the decoder 
155.sub.2 illustratively decodes pictures ranging from [TC=00:00:00:17] to [TC=00:00:00:27] 
(i.e., the picture for which the IN.sub.2 point is set, through the picture for which the OUT.sub.2 
point is set in GOP(n)). 

[0281] A range A.sub.l in FIG. 21 indicates that the pictures within that range (i.e., undisplayed 
pictures located prior to the picture for which the IN.sub.2 point is set) are decoded by the 
decoder 155.sub.2. As mentioned above, to implement real-time reproduction here requires that 
the undisplayed pictures be decoded by the decoder 155.sub.2 preparatory to decoding the 
picture for which the IN.sub.2 point is established. 

[0282] If the reproduction starting time for the clip #1 is taken as the reference, the OUT.sub.2 
point is defined as [TO00:05:00:12] at which the OUT.sub.l point is set, plus a period of time 
[00:00:00:10] ranging from the IN.sub.2 point to the OUT.sub.2 point of GOP(n) in the bridge 
clip. That is, the OUT.sub.2 point is located at [TC=00:05:00:22]. 
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[0283] Following the decoding of the picture for which the OUT.sub.2 point is set [at 
TC=00:05:00:22] and based on the description of lines 1 1 and 12 in FIG. 19, the decoder 
155.sub.l illustratively decodes pictures ranging from [TO00:00:01:03] to [TC=00:00:01:14] 
(i.e., the picture of GOP(o) for which the IN.sub.3 point is set through the last picture of 
GOP(o)). 

[0284] A range A.sub.2 in FIG. 21 indicates that the pictures within that range (i.e., undisplayed 
pictures located prior to the picture for which the IN.sub.3 point is set) are decoded by the 
decoder 155.sub.l preparatory to decoding the picture for which the IN.sub.3 point is 
established. 

[0285] If the reproduction starting time for the clip #1 is taken as the reference, the last picture of 
GOP(o) is defined as [TC=00:05:00:22] at which the OUT.sub.2 point is set, plus a period of 
time [00:00:00:1 1] ranging from the IN.sub.3 point to the OUT.sub.3 point of GOP(n) in the 
bridge clip. That is, the last picture of GOP(o) is located at [TC=00:05:00:33]. 

[0286] Following the decoding of the bridge clip [at TC=00:05:00:33] and based on the 
description of lines 14 and 15 in FIG. 19, the decoder 155.sub.l illustratively decodes pictures 
ranging from [TC=00: 10:00:00] of the clip #3 (i.e., from the first picture of GOP(o+l)) to a 
predetermined subsequent picture. 

[0287] The decoding process is carried out in the manner described above and the decoded 
pictures are displayed on the display unit 157. The switcher 156 suitably switches the decoder 
output to the display unit 157 in synchronism with the decoders being switched. 

[0288] FIG. 22 schematically shows how the display unit 157 provides its display. As shown in 
FIG. 22, real-time picture reproduction is guaranteed when decoding is performed based on the 
play list of FIG. 19 or when decoding is started at a suitable point in time preparatory to 
displaying each picture for which an edit point is set. 

[0289] As depicted in FIG. 22, the pictures, which are the objects of reproduction in the clip #1, 
clip #3, and bridge clip and which resulted from a non-destructive editing process (i.e., the 
pictures within the range indicated by hollow arrows in FIG. 16) are then displayed without 
interruption. 

[0290] Through the use of the disc apparatus 1 and reproducing apparatus 101 working as 
described above, the user as an editor is able to proceed with editing without having to be aware 
of whether or not the edited AV data will be eventually reproduced in real time. 

[0291] Decoding or re-encoding is not carried out during the creation of any bridge clips. This 
makes it possible to prevent degradation in the quality of pictures displayed in reference to the 
bridge clips. 

[0292] FIG. 23 is a block diagram sketching another typical structure of the disc apparatus 1 . Of 
the reference numerals in FIG. 23, those already used in FIG. 2 designate like or corresponding 
parts, and the descriptions of these parts will not be repeated where redundant. Unlike the disc 
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apparatus 1 of. FIG. 2, the disc apparatus 1 of FIG. 23 has a decoder selecting unit. 201 in the 
additional information creating unit 27. 

[0293] The decoder selecting unit 201 receives information about bridge clips from the bridge 
clip creating unit 26 via the control unit 22, picture pointers from the control unit 22, and device 
information such as the number of decoders furnished in the reproducing apparatus 101 from the 
control unit 22. In accordance with the received information, the decoder selecting unit 201 
creates decoder designation information as additional information and supplies the created 
information to the play list creating unit 28. 

[0294] In the earlier example, the reproducing apparatus 101 was shown selecting by itself the 
decoder to be used preparatory to reproducing AV data (in step S34 of FIG. 20). In this example, 
the disc apparatus 1 selects the decoder prior to decoding and has decoder designation 
information included in the play list. This allows the reproducing apparatus 101 rapidly to start 
its reproducing process without having to select the decoder preparatory to reproducing AV data. 

[0295] When a bridge clip is created, the GOP's making up that bridge clip should preferably be 
decoded by the same decoder as that which had been set to decode these GOP's before they were 
relocated into the bridge clip. 

[0296] For example, GOP(m+2) as part of the bridge clip shown in FIG. 21 should preferably be 
decoded by the decoder 155.sub.l that had been set to decode the clip #1 before GOP(m+2) was 
relocated to become part of the bridge clip. That is because the last picture of GOP(m+l) and the 
first picture of GOP(m+2), intended originally to constitute a continuous image sequence, could 
lose their continuity if different decoders were selected to reproduce the pictures one after 
another. 

[0297] To avert such a snag, the disc apparatus 1 designed to create bridge clips creates a play 
list containing decoder designation information. The play list is to be used as the basis for 
decoding AV data (bridge clips) to prevent eventual degradation in picture quality. 

[0298] Given the decoder designation information from the decoder selecting unit 201, the play 
list creating unit 28 creates the play list including codes for designating the decoders. The play 
list thus created is recorded to the optical disc 52 and offered to the reproducing apparatus 101. 

[0299] FIG. 24 is a block diagram giving another typical structure of the reproducing apparatus 
101. The reproducing apparatus 101 of FIG. 24 reproduces AV data in keeping with the play list 
created by the disc apparatus 1 of FIG. 23. 

[0300] Since the play list created by the disc apparatus 1 of FIG. 23 includes the decoder 
designation information, there is no need for the reproducing apparatus 101 to select decoders 
while reproducing AV data. Thus unlike the reproducing apparatus 101 of FIG. 6, the 
reproducing apparatus 101 of FIG. 24 does not include the decoder selecting unit 133 in the 
decode scheduling unit 123. 

[0301] The rest of the structure and the workings of the reproducing apparatus 101 in FIG. 24 are 
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the same as those of its counterpart in FIG. 6. That is, based on the play list and picture pointers 
supplied from the picture pointer reading unit 131, the decode scheduling unit 123 performs 
decode scheduling and outputs the results of the scheduling to the decoder controlling unit 124. 
The structure and the workings common to the two reproducing apparatuses will not be 
discussed further. 

[0302] Described below with reference to the flowchart of FIG. 25 is a typical process performed 
by the disc apparatus 1 of FIG. 23 to additionally furnish decoder designation information. This 
process is carried out in step SI 2 during the play list creating process discussed above with 
reference to FIGS. 12 and 13. Specifically, the process is effected if it is found necessary in step 
SI 1 to provide additional information to the play list. 

[0303] When the play list creating unit 28 gives an instruction that additional information is to be 
needed, step S51 of FIG. 25 is reached. In step S51, the decoder selecting unit 201 selects 
decoders so that all GOP's making up each clip will be decoded by the same decoder. Decoder 
designation information resulting from the decoder selecting process is output to the play list 
creating unit 28. 

[0304] In step S52, the play list creating unit 28 receives the decoder designation information 
from the decoder selecting unit 201 and adds the received information to the play list created in 
step SI Oof FIG. 12. 

[0305] FIG. 26 is a schematic view of a typical play list created in the process of FIG. 25. The 
play list of FIG. 26 is the same as that of FIG. 19 except that lines 6, 10, 13, 16, and 19 have 
additional descriptions for designating decoders. 

[0306] In FIG. 26, it is assumed that the decoder-designating description [decoder- '07] 
specifies that a clip #1 to which the description corresponds is to be decoded by the decoder 
1551, one of the two decoders in the reproducing apparatus 101. Likewise the decoder- 
designating description [decoder-' 1"/] is assumed to specify that the corresponding clip is to be 
decoded by the decoder 155.sub.2. 

[0307] In FIG. 26, line 6 with [decoder="0 n /] specifies that the decoder 155.sub.l is to decode 
pictures in the clip #1 between [TC=00:00:00:00] and [TC=00:05:00:00] as designated by codes 
on lines 4 and 5. 

[0308] Line 10 with (decoder="0 M /] specifies that the decoder 155.sub.l is to decode pictures in a 
bridge clip between [TC=00:00:00:00] and [TC=00:00:00:12] as designated by codes on lines 8 
and 9. 

[0309] Line 13 with [decoder= M 17] specifies that the decoder 155.sub.2 is to decode pictures in 
the bridge clip between [TC=00:00:00:17] and [TC=00:00:00:27] as designated by codes on 
lines 1 1 and 12. 

[0310] Lines 16 with [decoder= M 0'7] specifies that the decoder 155.sub.l is to decode pictures in 
the bridge clip between [TC=00:00:01 :03] and [TC=00:00;01 : 14] as designated by codes on 
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lines 14 and 15. 

[031 1] Line 19 with [decoder= M 0 M /] specifies that the decoder 155.sub.l is to decode pictures 
subsequent to [TC=00: 10:00: 15] in a clip #3 as designated by codes on lines 18 and 19. 

[0312] In the manner described above, the decoder designation information (i.e., descriptions) is 
included in the play list and provided to the reproducing apparatus 101 of FIG. 24. 

[0313] Described below with reference to the flowchart of FIG. 27 is a reproducing process 
performed by the reproducing apparatus 101 of FIG. 24 in accordance with a play list 
supplemented with additional information for designating decoders. 

[0314] The process shown in FIG. 27 is basically the same as that in FIG. 20 except that a 
decoder-selecting step (i.e., step S34 in FIG. 20) is not included. After the start of the data 
reproducing process, the play list is read and interpreted, as in step S61. As shown in step S62, 
picture pointers are read for clips to be referenced in the play list. Then schedule decode starting 
locations and decode starting times for each decoder based on the play list and picture pointers, 
as in step S63. Step S64 shows, acquiring file address of clips to be referenced from picture 
pointers. Then acquire physical address of clips to be referenced, as seen in step S65. In step 
S66 of FIG. 27, the decoder controlling unit 124 switches decoders based on the descriptions in 
the play list to reproduce (i.e., decode) AV data. Th e oth e r st e ps in FIG. 27 ar e th e sam e as thos e 
in FIG. 20 and thus will not be discuss e d furth e r. As in step S67, whether a stop operation is 
performed is determined. If a stop operation is not performed, then step S68 is reached, where it 
is determined whether reproduction is set to be terminated. If reproduction is not set to be 
terminated, proceed back to S66. If the result of step S67 or S68 is yes, the process is ended. 

[0315] If an optical disc 52 with the play list of FIG. 26 recorded thereon is loaded, AV data 
recorded on the disc together with the play list are decoded by the reproducing apparatus 101 of 
FIG. 24 switching the decoders as depicted in FIG. 21. 

[0316] As described, where the decoder designation information is included in the play list, the 
preprocessing involving selection of decoders performed in the process of FIG. 20 will not be 
carried out by the reproducing apparatus 101 of FIG. 24. This makes it possible for the 
reproducing apparatus 101 to start reproducing AV data more quickly than before. 

[0317] The feature above also makes it possible to ensure real-time reproduction of AV data by 
the reproducing apparatus 101. Furthermore, picture quality is improved because the decoders 
are switched in a manner giving priority to the continuity of pictures. 

[0318] In the foregoing explanation, the description [decoder^'O"/] or [decoder= f T f /] in the play 
list was shown designating the decoder to be used. Alternatively, where the reproducing 
apparatus 101 incorporates more decoders (i.e., three or more decoders), the decoders may be 
designated using descriptions with two or more bits in a format such as [decoder="007], 
[decoder="017],etc. 

[0319] FIG. 28 is a block diagram showing another typical structure of the disc apparatus 1. Of 
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the reference numerals in FIG. 28, those already used in FIG. 2 designate like or corresponding 
parts, and the descriptions of these parts will not be repeated where redundant. Unlike the disc 
apparatus 1 of FIG. 2, the disc apparatus 1 of FIG. 28 has a decode scheduling unit 21 1 included 
in the additional information creating unit 27. 

[0320] The decode scheduling unit 21 1 creates the above-described schedule information such as 
decode starting times and decode starting locations as additional information, and supplies the 
created information to the play list creating unit 28. The reproducing apparatus 101 of FIG. 6 
was shown performing decode scheduling and selecting the decoder preparatory to reproducing 
AV data (in steps S33 and S34 of FIG. 20). The disc apparatus 1 of FIG. 28, by contrast, carries 
out by itself decode scheduling and has the schedule information included in the play list. 

[0321] The feature above frees the reproducing apparatus 101 of the need to effect decode 
scheduling before AV data reproduction, and allows the apparatus 101 to start reproducing the 
data quickly. Furthermore, the feature guarantees real-time reproduction of AV data. 

[0322] The decode scheduling unit 21 1 carries out decode scheduling based on the edit list, 
bridge clip-related information, and picture pointers supplied from the control unit 22, as well as 
on device information such as the number of decoders furnished in the reproducing apparatus 
101. 

[0323] As discussed above with reference to FIGS. 8 through 9C, the decode scheduling unit 21 1 
detects pictures for which edit points are set from the edit list supplied from the control unit 22, 
and acquires picture types of the detected pictures from the corresponding picture pointers. With 
regard to each picture for which an edit points is set, the decode scheduling unit 21 1 detects the 
number of pictures required to be decoded preparatory to decoding that picture with the edit 
point, thereby determining a decode starting location and a decode starting time for the picture in 
question. 

[0324] The schedule information resulting from the scheduling process performed by the decode 
scheduling unit 21 1 is output to the play list creating unit 28. 

[0325] In accordance with the schedule information received, the play list creating unit 28 causes 
information for designating decode starting times (i.e., decoder switching times) to be included 
in a play list in the form of attribute information named illustratively [preDecBegin]. Where 
necessary, the number of I and P pictures to be decoded preparatory to decoding a given picture 
for which an edit point is set is also included in the play list in the form of attribute information 
named illustratively [preDecDur]. The play list containing these attributes is recorded to the 
optical disc 52 and provided to the reproducing apparatus 101. 

[0326] FIG. 29 is a block diagram depicting another typical structure of the reproducing 
apparatus 101. The reproducing apparatus of FIG. 29 reproduces AV data in keeping with the 
play list created by the disc apparatus 1 of FIG. 28. 

[0327] The play list prepared by the disc apparatus 1 of FIG. 28 includes the attribute 
information for designating decode starting times (i.e., decoder switching times). For that reason, 



38 



00402152 



PATENT 

Substitute Specification (Showing Changes) 

there is no need for the reproducing apparatus 101 to perform decode scheduling preparatory to 
reproducing AV data. Thus unlike the reproducing apparatus 101 of FIG. 6, the reproducing 
apparatus 101 of FIG. 29 does not have the decode scheduling unit 123 or the decoder selecting 
unit 133 that would have been contained in the unit 123. 

[0328] The rest of the structure and the workings of the reproducing apparatus 101 in FIG. 29 are 
the same as those of its counterpart in FIG. 6. That is, based on the play list and picture pointers 
supplied from the picture pointer reading unit 131, the decoder controlling unit 124 controls the 
decoders while decoding AV data. Illustratively, the decoder controlling unit 124 detects 
attribute information that designates decode starting times (i.e., decoder switching times) from 
the play list and, when any one of the designated times is reached, switches the decoders to 
decode AV data. The structure and the workings common to the two reproducing apparatuses 
will not be discussed further. 

[0329] Described below with reference to the flowchart of FIG. 30 is a typical process performed 
by the disc apparatus 1 of FIG. 28 to additionally furnish attribute information (i.e., information 
for designating decode starting times). As with the process of FIG. 25, the process of FIG. 30 is 
carried out when it is found necessary in step SI 1 of FIG. 13 to provide additional information 
for creating the play list. 

[0330] When the play list creating unit 28 gives an instruction that additional information is to be 
needed, step S81 of FIG. 30 is reached. In step S81, the decode scheduling unit 21 1 schedules 
the decode starting times and decode starting locations regarding each of the decoders. That is, 
the scheduling discussed above with reference to FIGS. 8 through 9C is carried out. The 
schedule information resulting from the decode scheduling process above is output to the play 
list creating unit 28. 

[0331] In step S82, based on the schedule information supplied from the decode scheduling unit 
21 1, the play list creating unit 28 supplements the play list created in step S10 of FIG. 12 with 
the preDecBegin attribute information designating decode starting times. This is how the play list 
containing the additional attribute information is typically created. 

[0332] FIG. 31 is a schematic view of a typical play list supplemented with the attribute 
information for designating decode starting times. The play list of FIG. 31 also includes 
preDecDur attribute information denoting the number of I and P pictures to be decoded 
preparatory to decoding each picture for which an edit point is set. The preDecDur attribute 
values (i.e., picture counts) are obtained illustratively from the table of FIG. 8. 

[0333] The play list shown in FIG. 31 is basically the same as the play list in FIG. 26, except that 
lines 1 1 and 14 are furnished with preDecBegin attribute and preDecDur attribute information 
each and that decoder designation information is not included. 

[0334] The portion [preDecBegin- '00:00:00:15] on line 1 1 specifies that decoding of a bridge 
clip designated by codes on lines 9 and 10 be started at [TC=00:00:00:15]. The portion 
[preDecDur= M 1 "/] also on line 1 1 indicates that the number of I and P pictures to be decoded 
preparatory to decoding the picture that should be displayed at [TC=00:00:00:17] is one. 
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[0335] Based on the attribute information above, the reproducing apparatus 101 starts decoding 
data at [TO00:00:00:15]. This allows the reproducing apparatus 101 to provide real-time 
reproduction of the bridge clip picture that is to be displayed at [TO00:00:00:17]. 

[0336] The decoding starting at [TC=00:00:00:15] designated by the preDecBegin attribute 
information is performed by a decoder different from the decoder that decoded the bridge clip 
specified by codes on lines 7 and 8. As described above, the decoders are switched at a point in 
time designated by the preDecBegin attribute information. 

[0337] Likewise, the portion [preDecBegin- '00:00:01:00"] on line 14 specifies that decoding of 
the bridge clip designated by codes on lines 12 and 13 be started at [TC=00:00:01 :00]. The 
portion [preDecDur= M 2 M /] also on line 14 indicates that the number of I and P pictures to be 
decoded preparatory to decoding the picture that should be displayed at [TC=00:00:01 :03] is 
two. 

[0338] The reproducing apparatus 101 thus starts decoding data at [TC=00:00:01:00] based on 
the attribute information above. This allows the reproducing apparatus 101 to provide real-time 
reproduction of the bridge clip picture that is to be displayed at [TC=00:00:01:03]. 

[0339] The decoding starting at [TC=00:00:01 :00] designated by the preDecBegin attribute 
information is performed by a decoder different from the decoder that decoded the bridge clip 
specified by codes on lines 9 and 10. 

[0340] In the manner described above, the information for designating decode starting times is 
included beforehand in the play list by the disc apparatus 1 and provided to the reproducing 
apparatus 101 of FIG. 29. 

[0341] Described below with reference to the flowchart of FIG. 32 is a reproducing process 
performed by the reproducing apparatus 101 of FIG. 29 in accordance with a play list 
supplemented with additional information for designating decode starting times. The process 
shown in FIG. 32 is basically the same as that in FIG. 20 or 27 except that decode scheduling 
(corresponding to step S33 in FIG. 20 or to step S63 in FIG. 27) is not carried out. 

[0342] Referring to FIG. 32, after the start of the data reproducing process, the play list is read 
and interpreted, as in step S91. As shown in step S92, picture pointers are read for clips to be 
referenced in the play list. Step S93 shows, acquiring file address of clips to be referenced from 
picture pointers. Then acquire physical address of clips to be referenced, as seen in step S94. 
The reproduction (i.e., decoding) is started in step S95. In step S96, the decoder controlling unit 
124 determines whether preDecBegin attribute information is detected from the code in the play 
list, which is currently referenced. 

[0343] If in step S96 no preDecBegin attribute information is found to be detected, step S98 is 
reached. Step S98 and the subsequent steps are carried out in the same manner as in the process 
discussed above with reference to FIG. 20. 
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[0344] If in step S96 any preDecBegin attribute information is found to have been detected from 
the currently-referenced play list code, then step S97 is reached. In step S97, the decoder 
controlling unit 124 switches the decoders at a point in time designated by the preDecBegin 
attribute information. The remaining steps of FIG. 32 are the same as those in the preceding 
description and thus will not b e discuss e d furth e r . If a stop operation is not performed, then step 
S99 is reached, where it is determined whether reproduction is set to be terminated. If 
reproduction is not set to be terminated, proceed back to S95. If the result of step S98 or S99 is 
yes, the process is ended. 

[0345] As described, where the information that denotes decode starting times is included in the 
play list, the reproducing apparatus 101 does not perform decode scheduling preparatory to AV 
data reproduction. Also, the reproducing apparatus 101 does not perform decoder selection 
because the decoders are set to be switched at each point in time designated by preDecBegin 
attribute information. 

[0346] Where the above-described process is implemented, the reproducing apparatus 101 of 
FIG. 29, given the play list of FIG. 31, causes the decoders 155.sub.l and 155.sub.2 to execute 
the decoding steps discussed earlier with reference to FIG. 21. 

[0347] That is, the decode starting time for the range A.sub.l in FIG. 21 (i.e., time to start 
decoding the necessary range of pictures preparatory to decoding the picture for which the 
IN.sub.2 point is set) is [TC=00:00:00:15] designated by the preDecBegin attribute information 
on line 1 1 in FIG. 3 1 . Likewise the decode starting time for the range A.sub.2 in FIG. 21 (i.e., 
time to start decoding the necessary range of pictures preparatory to decoding the picture for 
which the IN.sub.3 point is set) is [TC=00:00:01:00] designated by the preDecBegin attribute 
information on line 14 in FIG. 31. 

[0348] As shown in FIG. 21, the decoding starting at [TC=00:00:00:15] designated by the 
preDecBegin attribute information on line 1 1 in FIG. 31 involves having the decoder 155.sub.2 
replace the decoder 155.sub.l that decoded pictures up to that point (i.e., OUT.sub.l point). 
Similarly the decoding starting at [TC=00:00:01 :00] designated by the preDecBegin attribute 
information on line 14 in FIG. 31 involves having the decoder 155.sub.l replace the decoder 
155.sub.2 that decoded pictures up to that point (i.e., OUT.sub.2 point). 

[0349] In this manner, the reproducing apparatus 101 has no need to perform decode scheduling 
or decoder selection prior to AV data reproduction; the apparatus can start reproducing the AV 
data immediately, without preliminary steps. Furthermore, the reproducing apparatus 101 
working as described guarantees real-time AV data reproduction. 

[0350] The reproducing apparatus 101 need only switch decoders each time a point in time 
designated by preDecBegin attribute information is reached. This feature makes it possible easily 
to deal with changes in the hardware configuration such as more decoders getting added after the 
creation of a play list by the disc apparatus 1 . 

[0351] For example, suppose that the number of decoders in the reproducing apparatus 101 is 
raised after the play list shown in FIG. 26 has been created wherein decoders are designated 
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directly by the disc apparatus 1. In that case, the reproducing apparatus 101 is incapable of 
associating the actual decoders installed therein with the decoders designated in the play list and 
is thus barred from reproducing AV data in keeping with the play list. 

[0352] With the inventive arrangements in place, AV data can be reproduced based on a play list 
by equipment (i.e., reproducing apparatus) that has a different number of decoders from that 
which was envisaged during creation of that play list. The disc apparatus 1 can thus create 
general-purpose play lists that may be utilized by diverse kinds of equipment. 

[0353] Described below with reference to the flowchart of FIG. 33 is another information adding 
process performed by the disc apparatus 1 of FIG. 28. Unlike the process in FIG. 30, the process 
in FIG. 33 involves creating in step SI 12 a play list wherein not only preDecBegin attribute 
information for designating decode starting times is included but also the clips to be referenced 
are designated by file addresses. Step Sill in FIG. 33 is functionally the same as step S81 in 
FIG. 30. 

[0354] FIG. 34 schematically shows a typical play list created in the steps of FIG. 33. This play 
list is basically the same as that in FIG. 3 1 . 

[0355] On line 5 in the play list of FIG. 34, the clip to be referenced is designated not by a time 
code as in the play list of FIG. 31 but by a file address (logical address), i.e., 
[clipBegin="faddress=0.times.OOOOO" clipEnd= M faddress=0.times.002fa M ]. This file address is 
acquired by the play list creating unit 28 of FIG. 28 from the picture pointers supplied by the 
control unit 22. 

[0356] Likewise, the clips to be referenced are designated by 

[clipBegin="faddress=0.times.OOOO" clipEnd="faddress=0.times.001bc M ] on line 8., by 
[clipBegin="faddress=0.times.0045d M clipEnd= M faddress=0.times- .0084f '] on line 10, by 
[preDecBegin= M faddress=0.times.00421 n ] on line 11, by [clipBegin- Taddress^O.times.OOaOl" 
clipEnd= M faddress=0.times.00dfT] on line 13, by [preDecBegin= n faddress=0.times.00970 n ] on 
line 14, and by [clipBegin= M faddress=0.times.00ec0 M ] on line 17. 

[0357] Where the ranges to be referenced are designated by file addresses in the play list as 
described, the reproducing apparatus 101 of FIG. 29, after acquiring the play list, can skip the 
preparatory steps of obtaining the file addresses of the clips to be referenced from the picture 
pointers during reproduction. This feature also allows the reproducing apparatus 101 of FIG. 29 
to start reproducing the data more quickly than before. 

[0358] Described below with reference to the flowchart of FIG. 35 is a reproducing process 
performed by the reproducing apparatus 101 of FIG. 29 having acquired the play list of FIG. 34, 
Unlike the process in FIG. 32, the process in FIG. 35 skips the step of acquiring the file 
addresses of the clips to be referenced from the picture pointers (i.e., step S93 in FIG. 32). After 
the start of the data reproducing process, the play list is read and interpreted, as in step S121 . As 
shown in step SI 22, picture pointers are read for clips to be referenced in the play list. That is, 
the decoder controlling unit 124 of FIG. 29 acquires in step SI 23 the physical addresses of the 
clips to be referenced from the address managing unit 122 based on the file addresses described 
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in the play list. 

[0359] Having acquired the physical addresses of the clips to be referenced, the decoder 
controlling unit 124 proceeds with AV data reproduction using the same steps of FIG. 32 
subsequent to the stage of physical address acquisition. 

[0360] As a result, the reproducing apparatus 101 of FIG. 29 can start reproducing AV data more 
quickly than before without executing such preparatory steps as decode scheduling, decode 
selection, or file address acquisition. Reproduction of the AV data is guaranteed to be 
implemented in real time. The reproduction is started in step SI 24. In step SI 25, the decoder 
controlling unit 124 determines whether preDecBegin attribute information is detected from the 
code in the play list, which is currently referenced. If in step SI 25 no preDecBegin attribute 
information is found to be detected, step SI 27 is reached. If in step SI 25 any preDecBegin 
attribute information is found to have been detected from the currently-referenced play list code, 
then step SI 26 is reached. In step SI 26, the decoder controlling unit 124 switches the decoders at 
a point in time designated by the preDecBegin attribute information. As seen in step SI 27, if a 
stop operation is not performed, then step SI 28 is reached, where it is determined whether 
reproduction is set to be terminated. If reproduction is not set to be terminated, proceed back to 
SI 24. If the result of step SI 27 or SI 28 is yes, the process is ended. 

[0361] In the foregoing description, the disc apparatus 1 and reproducing apparatus 101 were 
shown being discrete devices. However, this is not limitative of the invention. Alternatively, 
these apparatuses may be integrated to form a single entity such as an information processing 
apparatus 221 shown in FIG. 36. 

[0362] Where the apparatus of FIG. 36 is in use, a play list created by a disc apparatus 1 included 
therein is output to an incorporated reproducing apparatus 101. In accordance with the play list 
received from the disc apparatus 1, the reproducing apparatus 101 reproduces AV data in real 
time. 

[0363] In the foregoing explanation, the play list created by the disc apparatus 1 was assumed to 
be recorded onto the optical disc 52 and provided to the reproducing apparatus 101. However, 
this is not limitative of the invention. Alternatively, the play list may be transmitted to the 
reproducing apparatus over a network together with AV data and picture pointers. As another 
alternative, the play list may be offered to the reproducing apparatus by means of the removable 
media 70 (FIG. 5) such as a memory card containing a flash memory, a removable hard disc 
drive, or an optical card. 

[0364] The foregoing description has mainly dealt with cases where the reproducing apparatus 
101 has two decoders. Obviously, the reproducing apparatus may alternatively incorporate one 
decoder, or three or more decoders. 

[0365] It has been assumed above that one GOP is made up of the pictures Bl, B2, 13, B4, B5, 
P6, B7, B8, P9, B10, Bl 1, P12, B13, B14, and P15. Alternatively, this invention may be applied 
to other GOP structures. 
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[0366] In the foregoing explanation, it has also been assumed that the AV data recorded on the 
optical disc 52 are the object of reproduction. Alternatively, this invention may be applied to 
reproducing AV data recorded on other recording media such as magnetic discs, magnetic tapes, 
or semiconductor memories; or to reproducing AV data transmitted through such media as the 
Internet. 

[0367] The series of steps described above may be executed either by hardware or by software. 
For the software-based processing to take place, the programs constituting the software may be 
installed in a general-purpose computer or like equipment. 

[0368] For the software-based steps to be carried out, the programs constituting these steps may 
be either loaded from dedicated hardware of a computer into its internal memory for execution, 
or installed upon program execution over the network or from a suitable recording medium into a 
general-purpose personal computer or like equipment capable of executing diverse functions. 

[0369] As shown in FIG. 5, the recording medium is offered to users apart from the apparatus 
not only as a package medium constituted by the optical disc 52 or removable media 70 
containing the programs, but also in the form of the ROM 62 or the hard disc drive in the storage 
unit 68, each storage device containing the programs and incorporated beforehand in the 
apparatus. 

[0370] In this specification, the steps, which are stored on the recording medium and which 
describe the programs to be executed by the apparatus, represent not only the processes that are 
carried out in the depicted sequence (i.e., on a time series basis) but also processes that may be 
performed parallelly or individually. 

[0371] The programs may be processed either by a single computer or by a plurality of 
computers on a distributed basis. The programs may also be transferred to a remote computer or 
computers for execution. 

[0372] To sum up, the arrangements according to the invention ensure real-time reproduction of 
AV data. The inventive arrangements also make it possible to start reproducing the AV data 
more quickly than before. 

[0373] While preferred embodiments of the invention have been described using specific terms, 
such description is for illustrative purposes only, and it is to be understood that changes and 
variations may be made without departing from the spirit or scope of the following claims. 
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